Content Perspective

I just read a blog post by Chuck Hollis at EMC about data deduplication and remembered how important that is to an EMC-platform. However, to me it is not just a way to improve or optimize storage, it is a critical part of any information architecture.

Data deduplication should be a core feature in platforms such as EMC Documentum which put the use of this feature up on the business side of things. Since everything stored in Documentum is an object which may or may not have an attachment in the form of a document that objekt can be exposed to users in one or many folders. The key thing is that these linkages opens up for interesting ways of using data deduplication.

Imagine a corporate environment with thosands of users. A lot of important documents in the company will be used many times by many people in different contexts. Since many of them likely are used as references in different projects such as corporate strategy, marketing documents so forth they are essentially read-only. However since a lot of users need these exact documents they will be imported many times in the repository and not only taking up unneccessary space but also create problems when these documents are updated. People will ask “hey, are all of these documents I found the same version?”

So my solution would be that we have a job running on import that highlights to the user that this particular document is already available and ask the user if they want to use the existing one instead. That renders a link being created to that document in their Folder or Project space.

We can also continously run a job doing reports on the the current status of the repository to see how many duplicates we have and what kind of content is duplicated the most. Documentum Reporting Services could be used to do that for instance. If we want a proactive Knowledge Management function they can either consolidate that directly or create tasks to users asking them if they agree to deduplicate some of their content. However, we need to push hard to have someone to create a really cool and usable interface to manage these “content conflicts”.

This will further help companies manage vital documents and further reduce the confusion of which document is the correct and updated one.

From a technology stand-point the first step would be to use a simple hash function to find exact duplicates but the next step should be to use vector-based indexing technology found in both Autonomy and FAST ESP to also detect similarity levels and possibly use that for further refinement of similar content. That way we de-duplicate the same content found in different formats and have the option of removing one of them or maybe just make one the rendition of the other.

Today the Swedish site IT-tjej (IT-girl) has been launched here in Sweden and I found a lot of interesting articles that made me think. Those of who know me know that I am not especially fond of Microsoft but the article featuring their female IT-evangelist Maria Lundahl was really intersting for me. She said that she enjoy the visibility she gets in the male-dominated IT-business and that people often are surprised when she explains what she is working with and why she loves it.

I am probably the only open transsexual woman working as a career officer in the Swedish Armed Forces so I know I am visible. Probably more than most people, even most women in male-dominated workplaces. Yesterday I wrote about my desire to blend in as “just another woman” and what do I think about this visibility then?

Well, first of all I guess it depends if I am visible because I am a woman or because I have a transsexual background or possibly both. I have decided to be open with my background just because I have been in a closet to long already. I believe in honesty and openness. However, it is not the first thing I say to new people when I meet them. So that is where I want to blend in and be just another woman. However, that is where my visibility as the only woman kicks in. The hard part is that I have not yet learned to figure out when people notice me because I am a woman or because “there is something unusual with me”.

Even though I am a career military officer I am passionate about IT and the possibilities it gives us. I am rather nerdy in the sense that I like to dive into the technical details of big enterprise systems such as EMC Documentum and FAST ESP to understand what makes them tick. So I guess that is unfortunately also something that is not so common among women. I hope this new website can be a place for all women (nerdy or not) in the IT-business to meet, learn, grow and get some inspiration from each other. I think that all women that work in something that is not generally seen as a typical female line of work sooner or later need to get together and compare notes from our daily experiences.

So do I like the visibility…Not necessarily but I must confess that people seem to remember who I am which usually is good 🙂 Whether it is because I am a nerdy female missionary of ECM-systems or an unsual women with a transsexual background I don’t know. And in most cases I guess I have to learn not to care to much.

So like Maria I get many arched eyebrows when I tell them what I do for a living. I guess people expect me to be a hair dresser or a nurse or something. However, it does not always bother me too much since I guess I am breaking new grounds both for women but especially for those with a transsexual background.