10-08-2012, 02:41 PM
DIGITAL IMAGE PROCESSING
DIGITAL IMAGE PROCESSING.doc (Size: 2.86 MB / Downloads: 72)
OVERVIEW
Digital Image Processing uses networks silicon storage appliances are uniquely suited to satisfy the stringent storage networking requirements currently necessary to provide film digital intermediate environments with the high-bandwidth, high Quality-of-Service content access needed to eliminate workflow-related bottlenecks while providing the scalability in performance and capacity for the next generation.
The digital image processing has a good understanding of the technology utilized in digital postproduction for film, as well as disk storage. The fairly new Digital intermediate Process (DI) is poised to revolutionize the way filmed content is delivered through a post production pipeline.
A variety of enabling technologies, including high-resolution sensors, scanners, compute and graphics processing, imaging software, networking and storage interconnects, file systems and disk storage have all advanced to a level that allows the development of a fully digital, real-time 2K film resolution pipeline.
IMAGE PROCESSING
The creative process in DI may be summed up as “image processing”. Specialized software-based tools provide grain management, dust and scratch removal, editing and compositing, color grading, real-time preview, and other specialized functions. Some of these functions, such as editing, compositing, color grading and preview require real-time fullspeed stream rates.
While most of the real-time streams in the creative process are heavily weighted towards playout (reads from disk storage), there are also many asynchronous, frame-by-frame writes that may or may not place a sequence or clip in a contiguous manner on the disk storage.
PERFORMANCE SIZING
Sizing the performance requirements of a DI network starts by looking at all of the aggregate data bandwidth desired and then deciding shat must be real-time, what can (or should) be off-loaded to local storage, and what can be allocated as background tasks.
For example, a typical 2K DI environment may have one or two real-time ingest streams (state of the art scanners can ingest at ~300MB/s), one or two real-time software color correction/playout streams (also at 300MB/s), and perhaps 100-200MB/s of miscellaneous access via Ethernet-attached render clusters, tape backups, non-real-time tape capture (CG files for example, etc). Calculating the aggregate bandwidth necessary for this scenario yields 1.3 to 1.4GB/s.
Note that guaranteeing such bandwidth under all circumstances is difficult. Both the disk drives themselves must be able to deliver the bandwidth under all conditions – including fragmented or very full file systems, mixes of large and small I/O patterns, mixes of reads and writes – and the shared file system that manages the concurrent content access must be able to keep up to the largely non-deterministic load. A delete of an entire 20-minute reel means deleting about 28,000 files.
CONNECTIVITY SIZING
The overall DI storage network architecture consists of the special and general-purpose computers that capture, manipulate, and output the content. It is important to create a detailed network diagram that includes all of the computers, network and storage switches, storage systems, etc. that must be integrated into the DI system.
Various operating system and networking subtleties are inherent in any large-scale computing environment. These should be thoroughly discussed and understood with the respective vendor(s) whose products play a part in the DI storage network.
CONCLUSION
The Digital Image Processing of Data Direct believes that Digital Intermediate is here today, and that the DataDirect S2A appliances are the premier, and perhaps only, storage networking products that can adequately handle the demanding requirements of a DI pipeline with reasonable simplicity and manageability.
The S2A roadmap will continue to augment the family’s advantages, and our premier partners in the post production market will help jointly provide an unbeatable solution for post production facilities, enhancing their competitiveness, expanding their business, and growing their profitability. We’ll see you at 4K and beyond!
DIGITAL IMAGE PROCESSING.doc (Size: 2.86 MB / Downloads: 72)
OVERVIEW
Digital Image Processing uses networks silicon storage appliances are uniquely suited to satisfy the stringent storage networking requirements currently necessary to provide film digital intermediate environments with the high-bandwidth, high Quality-of-Service content access needed to eliminate workflow-related bottlenecks while providing the scalability in performance and capacity for the next generation.
The digital image processing has a good understanding of the technology utilized in digital postproduction for film, as well as disk storage. The fairly new Digital intermediate Process (DI) is poised to revolutionize the way filmed content is delivered through a post production pipeline.
A variety of enabling technologies, including high-resolution sensors, scanners, compute and graphics processing, imaging software, networking and storage interconnects, file systems and disk storage have all advanced to a level that allows the development of a fully digital, real-time 2K film resolution pipeline.
IMAGE PROCESSING
The creative process in DI may be summed up as “image processing”. Specialized software-based tools provide grain management, dust and scratch removal, editing and compositing, color grading, real-time preview, and other specialized functions. Some of these functions, such as editing, compositing, color grading and preview require real-time fullspeed stream rates.
While most of the real-time streams in the creative process are heavily weighted towards playout (reads from disk storage), there are also many asynchronous, frame-by-frame writes that may or may not place a sequence or clip in a contiguous manner on the disk storage.
PERFORMANCE SIZING
Sizing the performance requirements of a DI network starts by looking at all of the aggregate data bandwidth desired and then deciding shat must be real-time, what can (or should) be off-loaded to local storage, and what can be allocated as background tasks.
For example, a typical 2K DI environment may have one or two real-time ingest streams (state of the art scanners can ingest at ~300MB/s), one or two real-time software color correction/playout streams (also at 300MB/s), and perhaps 100-200MB/s of miscellaneous access via Ethernet-attached render clusters, tape backups, non-real-time tape capture (CG files for example, etc). Calculating the aggregate bandwidth necessary for this scenario yields 1.3 to 1.4GB/s.
Note that guaranteeing such bandwidth under all circumstances is difficult. Both the disk drives themselves must be able to deliver the bandwidth under all conditions – including fragmented or very full file systems, mixes of large and small I/O patterns, mixes of reads and writes – and the shared file system that manages the concurrent content access must be able to keep up to the largely non-deterministic load. A delete of an entire 20-minute reel means deleting about 28,000 files.
CONNECTIVITY SIZING
The overall DI storage network architecture consists of the special and general-purpose computers that capture, manipulate, and output the content. It is important to create a detailed network diagram that includes all of the computers, network and storage switches, storage systems, etc. that must be integrated into the DI system.
Various operating system and networking subtleties are inherent in any large-scale computing environment. These should be thoroughly discussed and understood with the respective vendor(s) whose products play a part in the DI storage network.
CONCLUSION
The Digital Image Processing of Data Direct believes that Digital Intermediate is here today, and that the DataDirect S2A appliances are the premier, and perhaps only, storage networking products that can adequately handle the demanding requirements of a DI pipeline with reasonable simplicity and manageability.
The S2A roadmap will continue to augment the family’s advantages, and our premier partners in the post production market will help jointly provide an unbeatable solution for post production facilities, enhancing their competitiveness, expanding their business, and growing their profitability. We’ll see you at 4K and beyond!