• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    Several video cameras (11) provide images as analog signals. These are digitized and the digital images stored in a memory (19). The stored images are assembled into a common image, which is converted into an analog signal and fed to a monitor (16). In order to prevent outdated pictures from being displayed, all incoming video pictures are provided with a time stamp during digitizing, which is stored together with the video pictures in the memory (19). Then, when the stored images are composed and converted to an analog signal, the timestamps of the video images are read out and compared with the current time. Only when the time stamp is a maximum of a predetermined period of time, the analog signal is fed to the monitor (16). If the analog signals arriving from the video cameras (11) are first fed to inputs of a video matrix (13) which forwards the analog signals to specific outputs, it is expedient if an identification code (26) is modulated onto the analog signals and after the video matrix (FIG. 13) is demodulated to verify that the correct analog signal has been turned on.
    公开号:AT519108A4
    申请号:T51013/2016
    申请日:2016-11-07
    公开日:2018-04-15
    发明作者:
    申请人:Tb Traxler Gmbh；
    IPC主号:
    专利说明:

    The present invention relates to a method for reading and editing video images in real time, in which one or more video cameras provide images as an analog signal, wherein the images are digitized and stored in a memory, after which the stored images are processed and finally the processed images into a Converted analog signal and at least one monitor to be supplied.
    In the television sector, a distinction is made between (video) images and video signals. The separation is necessary on the one hand to distinguish a finished video frame from an electronically defined video signal for transmission, and on the other hand to separate the different tasks of image and video signal. Image refers to an entire image as seen on the screen while the video signal is needed to electronically transmit the image.
    Traditional systems for image transmission were constructed analogously, i. the picture taken by the video camera was transmitted analogously and displayed directly on a screen. Disruptions were immediately visible on the screen, either as a result of a camera problem or as a result of a problem along the transmission chain.
    Modern solutions for image transmission are designed to produce the highest possible image or to suppress interference. These include the automatic adjustment procedures in the video camera, the transmission path and the preparation of the image or the images in front of the screen. Based on the requirements of the entertainment television, no errors should be visible, it is better if a stored image is displayed on the screen during the error condition. For this reason, all modern transmission systems rather complex electronic circuits with image memories, starting in the video camera, possibly in the transmission path and finally in the image processing.
    In surveillance systems (which are used, for example, in railway stations to handle the trains) is often required today, on a screen several camera images, such as four camera images to represent simultaneously. This is analog only possible if all video cameras are synchronized with each other, and then only with specially adapted video cameras and a large amount of circuitry.
    The prior art is therefore to digitize the four incoming single images, store and then to create from the digitally stored images, the new composite image and transfer it to the screen. If the transmission to the screen is analog, the necessary sync signals must be regenerated.
    Disadvantage of this solution is that due to digitization larger delays can not be excluded. This is useless in monitoring traffic systems, since the time offset from the person watching the screen can not be detected. In two seconds, an approaching train can e.g. be driven a meter far, while a critical situation on the platform on the screen can not be seen. In a vehicle with 100 km / h, it would be over 50 m, which are driven without visual contact. Unfortunately, as a result of such a time delay, there has already been one fatality.
    It is an object of the present invention to provide a method of the type mentioned, in which too much delayed playback of video images is prevented.
    This object is achieved by a method of the type mentioned in the present invention that all incoming video images are provided during digitization with a time stamp, which is stored together with the video images in the memory that the stored images are then processed in the usual way and that in the Converting the processed images into an analogue signal The timestamp of the video image or - with simultaneous playback of several
    Video images - the timestamp of all reproduced video images is read and compared with the current time and the analog signal is supplied to the at least one monitor only if the time stamp is a maximum of a predetermined period ago or if all timestamps are a maximum of a predetermined period of time ago.
    Thus, according to the invention, it is attempted to work as far as possible with analog signals. Thus, the video camera delivers analog signals (without prior digital processing), so that no delay can occur here. The monitor also works analogously, so it indicates the video signal directly. Again, there can be no delay.
    However, as previously mentioned, it is difficult to do without digitization, especially when images from multiple video cameras are to be displayed on a monitor. Here the invention goes the way that during digitization each image is provided with a time stamp, and that stored images are only used if the time stamp is not too long ago. Thus, should an unexpected delay occur (e.g., because an image "lags" in memory and is not overwritten by new images, for example, due to a failure of the analog-to-digital converter), it will be detected and the image will not be displayed.
    The invention is based on the finding that it is better not to display any image than an outdated image, because this immediately recognizes that there is no useful information. If you e.g. sets the predetermined time to 100 ms, then the maximum time offset is well below the typical human response time, so do not bother; if the skew is higher, then no meaningful image (i.e., for example, only black, only white, a pattern) is displayed so that the disturbance is instantly recognizable.
    It is useful if the video image is deleted from memory as soon as it has been rendered and converted to an analog signal. This is an additional security measure to prevent obsolete images from being displayed. Even if a timestamp is accidentally recognized as being up-to-date even though it is outdated, such an out-of-date image can be displayed at most once, which is hardly noticeable (the usual refresh rate is 25 Hz).
    It is also customary that the analog signals arriving from the video cameras are first supplied to inputs of a video matrix which, depending on the control, forwards the analog signals to specific outputs. In this way, it is possible to turn on the monitor any video camera, or the combined image of several video cameras, which is also supplied this video matrix. However, such circuits that switch on analog signals depending on the digital drive may malfunction, especially in the event of severe electromagnetic interference. It may happen that the driver wants to switch on the video camera for the rearmost part of the train, because he has noticed in the combined image that there may be a door blocked, but actually sees another part of the train after switching and falsely from it assumed that all doors are properly closed. To prevent such a malfunction is provided according to an embodiment of the invention that an analog code is modulated on the analog signals and that this identification code is demodulated after the video matrix to check whether the correct analog signal has been turned on.
    If the identification code is already modulated in the video cameras, then it is also recognizable that the lines of the video cameras are connected in reverse. However, standard cameras can no longer be used.
    If the video signal of the video images is a standard video signal with black shoulder, the identification code of the black shoulder of the video signal can be imprinted, with color images preferably after the color burst (chroma burst).
    If an identification code is modulated on, the time stamp can be modulated along with it and also decoded together with it. This can possibly reduce the circuit complexity.
    With reference to an embodiment of the present invention will be explained in more detail. In the drawings: Fig. 1 shows a schematic circuit diagram of a circuit with which the method according to the invention can be carried out; and FIG. 2 shows an analog television signal with a stamped identification code.
    Several video cameras 11 (in the example, there are four video cameras) are connected to a video matrix 13. This video matrix 13 is a digitally controlled, electronic switch, which can forward a signal of any input to each output. At least one monitor 16 is connected to this video matrix 13 (in the example, there are two monitors). The video matrix 13 is controlled by a controller 14. It can e.g. be controlled so that the first monitor 16 shows the image of the fourth video camera 11 and the second monitor 16, the image of the first video camera 11. However, both monitors 16 can display the same image.
    Both the video cameras 11 and the monitors 16 are analog devices, i. the video cameras 11 provide analog signals and the monitors 16 process analog signals without ever digitizing the images in these devices. Thus, if a monitor 16 displays the image of a video camera 11, there can be no time delay.
    However, it is often desired that the images of four video cameras 11 are simultaneously displayed on a monitor 16 in four quadrants (or the images of two video cameras 11 in two halves). To accomplish this, the analog signals are fed from the video matrix 13 to an analog-to-digital converter 17, where they are digitized and fed to an FPGA 18 (FPGA = Field Programmable Gate Array).
    With the help of fast field programmable gate arrays, so-called FPGAs, reaction times in the nanosecond range are achieved. This fast response is not possible with the usual signal processors, because signal processors process the incoming signals sequentially, according to the specifications of the program. By contrast, FPGAs are programmable hardware, allowing up to 100 processes to pass through the device in parallel, regardless of the individual steps, with processing up to 500 times faster than in a signal processor.
    This FPGA 18 now stores the data supplied by the analog-to-digital converter 17 in a memory (RAM) 19, so that four images of four video cameras 11 are stored. From these images, the FPGA assembles 18 new images (in the example, it is two images), e.g. the images of all four video cameras 11 in the four quadrants of a new image and the images of two of the four video cameras 11 in the two halves of another new image. These new images, which are present digitally in the FPGA, are then converted back into analog signals in a digital-to-analog converter 20 and fed to the video matrix 13.
    Thus, each monitor 16 can display either a four-quadrant image, a two-half image or the image of each video camera 11 in full screen, depending on which signals the video matrix 13 applies to the corresponding output.
    The invention consists in the fact that the FPGA 18 stores a time stamp in addition to each image when saving the images and checks this time stamp when it assembles the new image. If the timestamp is too long, the stored image is ignored, i. the corresponding part of the new image (one quadrant or one half) remains dark. (Of course, a color or a pattern can also be displayed.) This makes it impossible for the new image to be assembled on the basis of outdated data.
    The invention prevents outdated information from being displayed. However, it goes without saying that this should only happen rarely. The entire arrangement is therefore designed so that the delays are normally very low.
    As an additional security measure, the FPGA 18 clears the data in the memory 19 as soon as it has been read out. Thus, each image of each video camera 11 can be used only once to build a new image.
    Another security risk is the video matrix 13, because there have been cases reported that such a video matrix has misconnected the inputs and outputs when strong interference fields have occurred. This may result in the driver seeing on the monitor 16 the image of another video camera 11 than he has set.
    To eliminate this security risk, 13 modulators 12 and behind the video matrix 13 demodulators 15 are provided in front of the video matrix. The modulators 12 impress the video signal with an identification code that can be decoded by the demodulators 15. The controller 14 now informs each demodulator 15 which
    Identification code due to the driving of the video matrix 13 is to be expected. If the identification code does not match the target value, the demodulator 15 interrupts the video signal. Even in this case, just in case of error, no display, which is decidedly better than a false display.
    The imposition of additional signals in a video signal is widespread. All color television systems use this method to transmit a color burst for synchronization. Similar solutions are described in large numbers in the patent literature (Group H04N7 / 025 of the International Classification).
    Referring to Fig. 2, the stamping of the identification code will be explained. This identification code is imprinted in the video signal, on the black shoulder. A classical CVBS signal in line mode has a line sync pulse 21 having a leading black shoulder 22 and a trailing black shoulder 23. The black shoulders 22 and 23 are used as a reference for a black image, the values are used in the screen 7 for the so-called clamping. The image content is encoded at location 24. A color burst 25 carrying the color modulation reference signals lies on the back porch 23. The identification code 26 is preferably written into the CVBS signal after the color burst 25. The identification code 26 may consist of a digital encoding in the nanosecond range because modern devices can easily handle these speeds.
    In one concrete solution, a modern, high-performance FPGA 18 was used, which reads in the digital data of all four video cameras 11 in parallel and provides all signals with a time stamp. With the reading, the images are already prepared for later position on the screen, cut away unnecessary image content and the image of each video camera 11 is written in a corresponding area of the memory 19.
    A circuit group in the FPGA 18 then recovers the necessary data for a combined image unless the timestamps are too long ago. To enhance security and to highlight malfunctions, the output memory is erased immediately after reading out and creating the composite image (the composite images), so that no still images can be displayed.
    The described measures make it possible to limit and check the cycle time of video signals within the FPGA to a maximum of 100 ms (milliseconds) and to check the correct interconnection in the video matrix 13. The cycle time of 100 ms results from the asynchronous operating state: An analog video signal requires 40 ms for the entire image transmission (at 25 Hz). Since the video cameras 11 are not synchronized, it may take a maximum of 80 ms for the data of all the video cameras 11 to be stored. This time the image may be in memory 19, with a safety margin of 20 ms. Anything longer in memory 19 is considered out of date and may no longer be displayed. This time of 100 ms is at most half the reaction time of an attentive person. Thus, the transfer is considered sufficiently timely to perform controls.
    In order to additionally prevent image parts of previous image data from remaining in the memory 19, the memory 19 in which the FPGA 18 composes the images into a dual image or a quadrant image is deleted after reading out, denoted by "0". This zero value corresponds to a black screen when converted to a video signal, and in an immediately following step, the memory is read out again to ensure that the contents of the memory have been erased.This read-out for control is only processed internally, it may no longer be informational In the event of a malfunction, a second reading as an image, a black image content would be transmitted to the screen, whereby the error is also recognizable as such for a normal observer.
    权利要求:
    Claims (6)
    [1]
    Claims:
    1. A method for reading and editing video images in real time, in which one or more video cameras (11) provide images as an analog signal, wherein the images are digitized and stored in a memory (19), after which the stored images are processed and finally the processed Converted images into an analog signal and at least one monitor (16) are supplied, characterized in that all incoming video images are provided during digitization with a time stamp, which is stored together with the video images in memory (19) that the stored images thereafter in the usual Be prepared and that in the conversion of the processed images in an analog signal, the time stamp of the video image or - with simultaneous playback of multiple video images - the timestamp of all reproduced video images read and compared with the current time and the analog signal to the at least one mon itor (16) is supplied when the time stamp is a maximum of a predetermined period of time ago or if all timestamps are a maximum of a predetermined period of time ago.
    [2]
    2. The method according to claim 1, characterized in that the video image is deleted from the memory (19) as soon as it has been processed and converted into an analog signal.
    [3]
    3. The method of claim 1 or 2, wherein the of the video cameras (11) incoming analog signals are first inputs of a video matrix (13) are supplied, which forwards the analog signals depending on the control to certain outputs, characterized in that the analog signals an identification code ( 26) is modulated and that this identification code (26) after the video matrix (13) is demodulated to check whether the correct analog signal has been turned on.
    [4]
    4. The method according to claim 3, characterized in that the identification code (26) in the video cameras (11) is modulated.
    [5]
    5. The method according to claim 3 or 4, characterized in that the video signal of the video images is a standard video signal with black shoulder (22, 23) and that the identification code (26) of the black shoulder (22, 23) of the video signal is impressed.
    [6]
    6. The method according to claim 5, characterized in that the identification code (26) of the black shoulder (23) after the color burst (25) is impressed.
    类似技术:
    公开号 | 公开日 | 专利标题
    EP2147844B1|2017-12-13|Device for monitoring an area in particular in the vicinity of or within a vehicle
    DE2920331C2|1982-06-09|Circuit arrangement for marking the trajectory of a moving object on the television screen
    AT519108B1|2018-04-15|Method for reading and editing video images in real time
    DE3114275A1|1982-11-04|METHOD AND CIRCUIT ARRANGEMENT FOR HIDDEN ERRORS IN A DIGITAL VIDEO SIGNAL
    EP0445336A1|1991-09-11|Method and device for reducing the edge flicker of a television picture
    EP0471878B1|1996-04-10|Method of picture-in-picture superimposition and apparatus for following the method
    DE3623576A1|1988-01-21|METHOD AND DEVICE FOR ELECTRONIC TRANSMISSION AND / OR RECORDING AND SUBSEQUENT PLAYBACK OF STEREOSCOPIC TELEVISION IMAGES
    DE102011007518A1|2012-10-18|Display device for use in passenger car for displaying vehicle settings, has display comprising dual/split view mode that provides two images simultaneously and each display image individually visible from multiple view points
    DE19545356C2|1998-04-16|Device for displaying stereo video images
    DE3128727C1|1983-02-24|Method and arrangement for increasing the frame rate
    EP0945031B1|2002-03-20|Process and circuit arrangement for converting the format of three-dimensional electronic images produced by horizontal polarisation
    DE3207028A1|1982-09-16|ARRANGEMENT FOR IMPROVING THE READABILITY OF LETTERING CHARACTERS
    DE2435794A1|1975-03-13|TELEVISION RECEIVER EQUIPMENT
    DE4311480A1|1993-10-14|Switching device for digital signals
    DE2920303C2|1984-02-16|Device for transmitting video signals
    DE2652935A1|1978-05-24|METHOD AND ARRANGEMENT FOR IMAGE FREQUENCY CONVERSION
    EP0701366A2|1996-03-13|Television apparatus
    DE69634676T2|2006-01-19|Image display device
    DE3442890A1|1985-06-13|TELEVISION CIRCUIT ARRANGEMENT FOR A FLICKER CORRECTION
    DE19962730A1|2001-07-12|Vehicle headlamp, has light detector to detect light reflected by dirt on outside of headlamp cover with filter element in front of light detector to pass light wavelengths emitted by headlamp
    DE3903922C2|1998-11-26|Device for synchronizing video signals
    DE102004020541B4|2010-07-22|Arrangement and method for controlling multiple graphic displays
    DE2141886C3|1975-09-11|Method for quadrature demodulation of PAL color television signals
    DE102007001843B4|2010-11-18|Method for processing image data
    DE2818288C2|1982-06-03|Color television receiver circuit for decoding PAL color television signals
    同族专利:
    公开号 | 公开日
    AT519108B1|2018-04-15|
    EP3319315A1|2018-05-09|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US20080303901A1|2007-06-08|2008-12-11|Variyath Girish S|Tracking an object|
    US20100188513A1|2009-01-29|2010-07-29|Victor Joseph Duvanenko|System and method for monitoring connections within an analog video system|
    DE102008034160A1|2008-07-22|2010-03-18|Siemens Aktiengesellschaft|Device for monitoring a spatial area, in particular in the environment or inside a vehicle|
    DE102009060845A1|2009-12-29|2011-06-30|Funkwerk plettac electronic GmbH, 90766|Method for the secure transmission of video signals from multiple video sources over a network to multiple monitors|
    EP2879381B1|2012-07-26|2019-09-04|Kyocera Corporation|Image monitoring device, mobile body, program, and failure determination method|
    DE102014008808A1|2014-06-11|2014-11-27|Daimler Ag|Method for securing the transmission of safety-related camera images|
    DE102015014190A1|2015-11-03|2016-05-25|Daimler Ag|Method for securing a transmission of safety-related camera images|DE102018125790A1|2018-10-17|2020-04-23|Rheinmetall Electronics Gmbh|Device for the validatable output of images|
    DE102019111178A1|2019-04-30|2020-11-05|Rheinmetall Electronics Gmbh|Device for the validatable output of images|
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    ATA51013/2016A|AT519108B1|2016-11-07|2016-11-07|Method for reading and editing video images in real time|ATA51013/2016A| AT519108B1|2016-11-07|2016-11-07|Method for reading and editing video images in real time|
    EP17181318.1A| EP3319315A1|2016-11-07|2017-07-13|Method for importing and processing video images in real-time|
    [返回顶部]