24-10-2016, 03:24 PM
1460877134-saiwebbasedmedical.docx (Size: 453.99 KB / Downloads: 7)
ABSTRACT
This focuses on the inception of a system for designating and archiving large-scale medical data. Specifically, this case study demonstrates a prototype system of paradigm of research aiming at fortifying up a distributed archival system over internet. The system enables data repository , subsistence, partaking, refurbishing and resurrection of medical files based on the extant internet facilities and the state-of-the-art literature is in medical image indexing and multimedia information presentation. It also incorporates our current research in image resurgence and multimodal medical image fusion. It surpasses the existing systems in the commercial and research sectors as it provides conducive, decisive, emphatic, and impressionable online concoct annotation, and multimodal querying capabilities in one forum. The patient inwardness contention is well dispatched when the rationing of the medical information is dispensed. This technology will reinforce medical practitioners/researchers by enabling efficacious management and sharing of medical files within or across a community, without being subjected to geographical restrictions and outward the quandaries of capricious and shattered medical data.
Contents:
1. 1.Introduction
2. System Architecture
3. System Functionalities
4. Implementation
a. Image Indexing
b. Multimedia Presentation
c. More Modalities of the Information
5. Conclusion
6. References
1. INTRODUCTION
This research concerns with proposing a new paradigm of managing and archiving large scale medical data. This research demonstrates this new paradigm through a prototype web-based medical data archive system. This system allows storing, maintaining, sharing, updating, and retrieving medical files based on the existing internet facilities. Medical files typically contain data in different modalities, such as text description either in print-typing form of in handwriting form, audio recordings, image files including Nuclear Medicine, MRI, CAT, Mammography, Ultrasound Imagery, etc., as well as possibly video clips. Currently, even though significant progress has been made
towards archiving medical data in digital forms, there are still many medical centres or hospitals archiving medical files in the physical forms. As the population of this world increases , a new medical diagnostic technologies is being developed and applied in the clinical practice resulting in more new modalities and increasing amount of medical data for each patient .The conventional archival system exhibits major problems in accommodating the avalanching demand for archiving and managing medical data.
The problems are:
(i) More physical space will be necessary to maintain the medical files
(ii) More manpower is necessary to maintain the medical files
It will become less efficient and more difficult to access and retrieve a particular medical file. Even though the digital archival systems are available today, the medical files are typically inconsistent and fragmented, varying from different medical institutions or medical centres to different hospitals, and there is still a substantial effort that is necessary in order to keep the medical data archival systems consistent, efficient, and effective in storing and retrieving data. With the fast augmentation of computer technologies , multimedia database and the Internet technologies, it is possible to archive all the medical data into a “central system “so that all the medical practitioners and researchers in a membership controlled community can share and access to this system conveniently and consistently without all the hassle imposed by the conventional archival system. This is the actuation of this research, as well as of the development of our prototype system. A typical scenario is depicted here . Assume that the “central” archival system is located in a computer server at America. A medical practitioner in Seattle, WA, is reviewing medical files of a patient. He/she decides to consult with the database for the previous diagnostic approaches made by his/her colleagues in the same community for those patients who happen to exhibit certain similar medical symptoms. To do so, he poses a query to the system through a standard browser in his/her PC . It may be a complicated query consisting of data in different modalities. An extreme case is that he could send the whole set of files of this patient as the query, which includes information in possibly many symptoms. Our system provides a base to the user to review all the files in different modalities by popping up different windows to present the files and allows the user to do online processing and annotation directly on top of the files by writing down annotation on top of the physical medical files. The user could then save the processed files and/or the original files along with the newly written annotation into his local folders, or contribute them to the whole community by uploading the files back to the system, so that this information will be archived in the system, and can be shared by other colleagues in the community provided he is willing to share. Applying multimedia technologies to medical archive system had been a focussed research in years since 90’s (e.g., [1,2]). With the advent of Internet, more research is proclaimed in combining Internet technologies with multimedia research in designing and developing medical archive systems (e.g., CoMed [3]). Our system differs from the existing systems in the sense as it not only offers a full spectrum of online communications, processing, and annotation tools, but also provides powerful multimodal search functionalities to the users. In addition, the database is always kept in “live” mode such that information contributed by users is periodically indexed. This paper is organized as follows. The next section describes the architecture of our system, and then is followed by a section documenting the implemented functionalities of the currently developed preliminary system. Finally, the paper is concluded with the current on-going development on the prototype system.
2.SYSTEM ARCHITECTURE
The architecture of the system subsists of the standard 3-tier, browser-server model. The client machine can be any machine with any operating system provided it is connected with the Internet, and has a standard browser. After a user logins into the system, Java Applet is downloaded to kick- start the communication with the server. The server consists of a middleware and a backbone database system. The middleware is implemented using Java Servlets and Java Server Pages (JSPs), and the backbone uses Oracle 9i database. The communication between the client Applet and the server Servlet is implemented using object serialization. The communication between the middleware and the backbone uses JDBC (Java DataBase Connectivity) and RMI (Remote Method Invocation). In the current preliminary version of our system, the middleware is J2EE compliant web server (Java Web Server) hosted on a SUN Enterprise 250 server with a dual processor running Solaris 7, 1 GB memory, and 18 GB hard disk; and the backbone machine is a Dell TPX 800 MHz Pentium III running Windows 2000 with 512 MB memory and 40 GB hard disk. While the whole system architecture is implemented in Java, some libraries (engines) of the processing, annotation, and querying tools are implemented in C++ for the efficiency consideration. Figure 1 shows the architecture
2. SYSTEM FUNCTIONALITIES
Our system overtures the user the following implemented functionalities in the preliminary version:
• Data management: Users may save the browsed or annotated or processed documents into their local machines, or if they crave, they can contribute these documents to the community by uploading them into the database, which avows data sharing among their colleagues.
• Online data processing: Users may implement tools available in the system toolboxes to do the online processing for the documents they are reviewing. The modality-dependent toolboxes are evolved in close collaboration with clinicians and medical researchers. The currently accessible tools include zoom in and zoom out for either global of local areas of a document, arithmetic image processing (e.g., addition of two images, layer analysis for a composition of up to four individual images, etc.), pseudo colouring, thresh- holding, histogram analysis, etc. The algorithms used in these functionalities are from the extant literature (e.g., [4]). Figure 2 (a)-© show examples of part of these functionalities.
• Macro Language: Users can write/record their own retrieval/processing protocols and add their customized analytical tools.
• Online annotation: Different graphical tools (e.g., ellipse, rectangle, line, etc.) as well as different text fonts and colour choices are feasible for online annotation. Users can write or voice dictate (provided that a local computer is equipped with microphone) their annotations directly on top of a document in review, or write or voice dictate their annotation on the specially available blank space next to the document in the annotation window if they crave. The annotations and the graphical information will be indexed separately after they are uploaded into the database. Figure 2 {d} shows an example of annotating an image.
• Powerful querying capabilities: In addition to the standard SQL queries, text based and image-based queries are also available to users, and user-friendly graphical interfaces are available to avow multimodal query and retrieval. The SQL query facilities are directly provided by Oracle 9i [5], and are incorporated into the system. The text query functionalities are implemented based on Inverted File Indexing scheme [6]. The image query functionalities are implemented using histogram indexing [7].
• Membership control: Password protected membership control to make sure that the sensitive and private information is only accessible to the members of the
community.
3. CURRENT WORK
While the aim of developing the preliminary system was to assemble each component using existing technologies to show the proof-of-concept for the novel archival paradigm our system represents, the current work focuses on furthering the research by upgrading the preliminary system into a real application system by improving the performance of the developed functionalities and by developing new functionalities. Specifically, the following three areas are identified for further research and improvement.
4.1 IMAGE INDEXING
It is a well-received area in multimedia research [7,8], as image related search typically is notoriously expensive, and often fails to deliver an effective retrieval (an effective retrieval refers to the fact that retrieved images are semantically related to the query posed). In this task, a number of state-of-the-art image indexing algorithm from this research community are applied and combined to replace the simple histogram based indexing. One of such indexing algorithms is the Geometric Histogram algorithm developed recently by Rao, Srihari and Zhang [8], which exploits geometric constraints of intensity values with respect to the spatial pixel distribution, and applies these constraints into histogram. The preliminary evaluation suggests that geometric histogram has promising potential in image indexing, and therefore, is taken as a candidate image indexing algorithm in this task.
In addition to a good indexing algorithm, a “good” database organization data structure is also necessary when an efficient retrieval is desired. (An efficient retrieval refers to an acceptable response time when the retrieval is completed after a query is posed). Several advanced spatial data structures are considered and reviewed [9], and the upgraded version of our system will be based on one of these structures as opposed to the simple arrays of images.
4.2 MULTIMEDIA PRESENTATION
Multimedia presentation is another well-received area in multimedia research [10]. After a query is processed and all the retrieved documents are ready to deliver to the user, multimedia presentation concerns with how to present the information to the user who made the query. A good presentation can not only deliver the retrieved documents to the user, but also deliver the information in a way the user feels most “comfortable” with. Since for different users, their personal interests are different, and their personal preferences are different, a “good” multimedia presentation should be able to be individualized to match each user’s personal interest and preference. This can be done by first tracking down the user’s browsing patterns over a period of time, and then analyzing the patterns to infer what most likely the user’s personal interest and preference are, and finally forming a presentation plan based on the inference. This research is being carried out and is being incorporated into the next version of our system.
4.3 IMMUTABILTY
Archives are often implemented to meet local or national compliance regulations governing the availability and retention of data, most often in healthcare industries. [11]
Immutability is often a main attribute of archival storage systems. Once the data is committed to an archive, it cannot be changed or deleted until its retention period has expired. This is often referred to as a WORM archive or content-addressed storage (CAS). Files are typically assigned a unique identifier that is stored along with the data when it's written to the archive. In many cases, any data retrieved to support litigation must be from an immutable archive -- otherwise there is no way to determine authenticity of the data. Some archives can port to tape or virtual tape libraries (VTL) so that archives can be backed up periodically. This can be achieved here.
4.4 MORE MODALITIES OF THE INFORMATION
While the preliminary version of our system only focused on data in image and text, new modalities of information such as audio, video, and mouse pointing are being added into the system for the next version, as a general medical archive system is likely to contain information other than image and text. Due to this requirement, indexing algorithm for each the media types are evolved and the user interface is upgraded to accommodate the interactions between a user and the system for different modalities of information.
4. CONCLUSION
This paper instants a new paradigm of archiving medical data based on linking the state-of-the-art multimedia research with the Internet facilities. The system-concept attempts a unique solution to the medical archiving quandaries. It surpasses the extant systems in the mercantile and in the research sectors as it provides conducive, efficacious and tractable online processing, annotation and multimodal querying capabilities combined together. A preliminary version of our system is fully implemented and in evaluation that contains over 2000 medical images in different modalities along with associated annotation text for each of the images. This technology will assist medical practitioners/researchers by enabling efficient management and sharing of the medical data within or across a community without being subject to geographical restrictions and without creating problems of inconsistent and fragmented medical data.