Course 014 Digital Camera Systems
Available course dates
This course has no planned course dates.
If you are interested in this course, contact us at cei@cei.se
014 Digital Camera Systems
TECHNOLOGY FOCUS
All camera applications rely on solid-state image sensors.
However, if consumers were forced to choose a digital camera on the basis of the raw data produced by the imager, it would be very doubtful that anyone would buy a digital camera. The data produced by a solid-state image sensor is contaminated by various noise sources, by defects, by inconsistencies, and many other error sources. To make matters worse, the solid-state image sensors do not themselves produce a coloured image – it is the data processing that must correct all these potential errors and even regenerate the colour information in the post-processing stage. So, what a person actually sees on a display or hard copy is absolutely not the same as what the imager has captured: what you see is not what you got!
As we can foresee that our homes, offices and cars soon will be fully equipped with cameras to make life safer and more enjoyable and to reduce our workload, we can recognize the digital camera technique as a forefront technology. Even today, for many applications imaging is in the embryo stage of its development.
COURSE CONTENT
The objective of this course is to provide theoretical familiarity and hands-on experience with digital cameras and associated topics with focus on the overall system aspects.
The path on which the photons enter and the digital numbers exit is long and complex. The course will describe this path with all its shortcomings, and provide examples of how these can be overcome.
Hands-on sessions will form a strong backbone of the course, complemented by a number of tutorial lectures. Many examples of images will be used to explain the various details. The course is not aimed at demonstrating existing products; on the contrary, computer animations and simulations will be used throughout the course to achieve a realistic experience.
WHO SHOULD ATTEND
No detailed knowledge of device physics is assumed. The course is developed to give an in-depth understanding of digital camera systems and technologies to engineers who are active in the field, and to give those with a theoretical knowledge an opportunity to learn more about the practical issues. The course will provide a valuable update on the latest developments in this rapidly changing technology.
The main difference with course #013 Digital Imaging: Image Capturing, Image Sensors – Technologies and Applications is the fact that course #013 is primarily focusing on the sensor, while this course is targeting the system around the image sensor. The two courses can be seen as twins: they really belong to the same parents, but they are like two-egg twins. Besides their common background, the two courses are completely different from each other, but are complementary to each other as well. The two courses can be attended fully independent of each other.
Daily Schedule
Day 1
The Image Sensor, the Optics, Image Processing: A Review
The course begins with a brief overview of the basic theory of solid-state image sensors pexels and 2D array. The imager is of course only a small, but vital, component of the complete camera system. The effect of the spectral content of the light sources will be discussed. Lectures on optics and on digital image processing are included to form a strong backbone for the remaining parts of the course. A calculation of how many electrons will be collected (to form the digital output signal of the image sensor) as a function of the light intensity will demonstrate the conversion of photons to electrons to voltages to digital numbers.
Day 2
Image Quality
Noise (spatial and temporal noise sources), defects (dead and sick pixels, soft and hard errors), irregularities of the signal, and inconsistencies can all deteriorate the quality of the image. We will discuss where these problems come from, how they can be mitigated, and if this is not possible, how they can be corrected. The dilemma that correcting one effect can have a negative impact on some other camera parameters will be discussed.
Correction of artifacts sometimes sounds pretty easy, but “someone has to pay the bill”, and this is very often the signal-to-noise ratio of the signal. The effect of several data manipulations (summing, subtracting, multiplying, dividing) on the sensor’s output signal will be discussed in relation to the signal-to-noise ratio of the digital camera.
Day 3
Digital Camera Systems
- Dark Current Compensation: The average value of the dark current can be corrected by the use of dark-reference lines/pixels. Fixed-pattern noise can be corrected by means of dark frame subtraction. How efficient are these techniques? What is their influence on signal-to-noise performance and what about temperature effects?
- Colour Interpolation: The Bayer pattern sampling is extensively used in digital imaging, but the sampling is only half of the story. The other half is the demosaicing or interpolation. Several methods will be discussed and compared with each other.
- White Balancing: The human eye is adapting easily and quickly to the spectrum of a light source, the image sensors do not adapt at all! How can we deal with this “shortcoming” of the imagers?
- Defect Correction: How can defect pixels be corrected without any visible effect? Can similar techniques also be applied to correct defect columns?
- Noise Filtering: A very important issue in data processing is the filtering of any remaining noise. This can be done in a non-adaptive or an adaptive way. What are the pros and cons of the various techniques?
Day 4
Digital Camera Systems (cont´d)
- Colour Matrixing: Nobody is perfect, neither are the imagers that suffer from optical cross-talk and from imperfections when it comes to the transmission characteristics of the colour filters. Colour matrixing takes care about these issues. Question is how to find to optimum correction matrix coefficients?
- Contouring: This is a technique to “regain” details, edges and sharpness in an image. But quite often not only the details are enhanced, but the noise in the image as well. Various contouring techniques will be discusses and compared with each other.
- Lens-Vignetting: Lenses have a strong fall-off of intensity and sharpness towards the edges. On top of that, also the image sensor will add an extra fall-off of intensity. Is correction possible? How complicated needs the correction to be to become invisible for the observer?
- Auto-focusing: How can the data of the image sensor itself being used to activate the auto-focusing function?
- Auto-exposure: How can the data of the image sensor itself being used to optimize the exposure time of the imager?
ALL COURSE DATES FOR THE CATEGORY: Sensors and Digital Imaging
014 Digital Camera Systems
020 Advanced Course on Image Sensor Technology
063 Advanced Optical Sensors: From Detectors to ASIC Integration with Edge AI and Functional Safety Considerations
Instructor: Dr. Farzad Parsaie
Optical sensors are evolving toward intelligence, downsizing, and multi-functionality, with critical roles in functional safety applications like autonomous driving, industrial automation, and medical diagnostics. Artificial Intelligence (AI) is enhancing optical sensor performance by improving data processing, signal-to-noise ratios, and handling dynamic scenarios, essential for high-fidelity measurements in these fields. This course covers these advancements, from photodetector fundamentals to ASIC integration and interfacing, with a focus on Edge AI and Functional Safety. Read full course description including course schedule063 Advanced Optical Sensors: From Detectors to ASIC Integration with Edge AI and Functional Safety Considerations
063 Advanced Optical Sensors: From Detectors to ASIC Integration with Edge AI and Functional Safety Considerations
835 A 360-degree View of the Sensors for Industrial Applications – Focusing on the Inductive Sensors
He is a new instructor of the CEI-Europe and is a professional expert on the subject of design and manufacturing of electronic sensors and ASIC designing, testing, and release for such products. After more than 25 years with one of the 10 global players on the field of industrial sensors – Balluff GmbH Company, Germany – he is currently as a freelancer in his consulting office FerSensC / Leonberg, Germany, carrying out sensor design projects and consulting.
Read full course description including course scheduleE-Course 601 Introduction to Correlated and Uncorrelated Noise in Imagers
Instructor: Professor Albert J.P Theuwissen
Introduction to Correlated and Uncorrelated Noise in Imagers In the introduction of the course, the difference between Correlated and Uncorrelated Noise will be explained. In a first instance, one can put all fixed-pattern noise sources or noise in the spatial domain under the header of Correlated Noise, and one can put all temporal noise sources or noise in the time domain under the header of Uncorrelated Noise. The course includes:- 42 minutes on-demand video
- 9 modules
- 3 months access
E-Course 602 Characterization of Noise in Dark
Instructor: Professor Albert J.P Theuwissen
Characterization of Noise in Dark It may sound strange that an image sensor, which is made to capture light, will be characterized first in dark conditions. But actually this should not really be surprising because noise will first become visible in the darkest parts of an image. For that reason the dark performance of an image sensor plays crucial role. It also sets the lower end of the dynamic range…… The course includes:- 116 minutes on-demand video
- 37 modules
- 3 months access
E-Course 603 Characterization of Noise with Light
Instructor: Professor Albert J.P Theuwissen
Characterization of Noise with Light In the third and last part of the course, the image sensor will be characterized with light input. First the fixed-pattern noise (= correlated noise) will be measured, and next the temporal noise (= uncorrelated noise) will be characterized. All measurements will be based on an existing camera and with uniform light input. For both noise types, correlated and uncorrelated, some extra statistical operations will allow to split the overall noise characterized into a contribution on row level, on column level and on pixel level. This gives very useful information on where to find the root cause of the noise sources. The course includes:- 126 minutes on-demand video
- 34 modules
- 3 months access
E-Course Bundle 601-603 Advanced course in image sensors and digital cameras
Instructor: Professor Albert J.P Theuwissen
The course includes:- 284 minutes on-demand video
- 80 modules
- 12 months access