Digitale Planung und automatisierte Produktion von Gebäude-integrierter Photovoltaik, Teilvorhaben: Erfassung, Digitalisierung, Klassifizierung und Strukturierung von Gebäudeoberflächen

Research project funded by the Bundesministerium für Wirtschaft und Klimaschutz.

• Digi-PV project
• Project description at ISFH

Automatisiertes Green-ML anhand des Anwendungsbeispiels Fahrerassistenzsysteme - Automated Green-ML with Application to Driver Assistance Systems

Research project funded by the Bundesministerium für Umwelt, Naturschutz, nukleare Sicherheit und Verbraucherschutz.
VISCODA collaborates with AI (Institut für Künstliche Intelligenz), TNT (Institut für Informationsverarbeitung) , and IMS (Institut für Mikroelektronische Systeme).

• Project description at LUH AI
• KI Landkarte

Cloud-Anwendung für zeitlich veränderliche Fahrbahnzustandsinformationen für verschiedene Fahrzeugklassen basierend auf fusionierten Fahrzeugdaten von Fahrzeugen verschiedener Klassen (LKW/PKW) – Cloud application for time-varying road condition information for different vehicle classes based on fused vehicle data from vehicles of different classes

Detection, localization, and classification of road conditions in real-time from the in-vehicle front camera. Estimation of vehicle specific road friction by fusion with information from other sensors (such as vibroacoustic, meteorologic, or traction control responses). A cloud based service increases traffic safety and efficiency for driving assistance and automated driving applications.

• Press Release (German)
• Overview (German)
• Final Demonstration: 16.01.24, 10h – 16h, Erich-Reinecke-Testbahn Contistraße 1, 29323 Wietze

Publications:

• K. Cordes and H. Broszio: "Camera-Based Road Snow Coverage Estimation", ICCV Workshop: roBustness and Reliability of Autonomous Vehicles in the Open-world (BRAVO), 2023, paper at CVF, paper at ieeexplore
  
  • RoadSC demo video [youtube]
    
  • RoadSC dataset
    
  • Poster [pdf]
• K. Cordes, C. Reinders, P. Hindricks, J. Lammers, B. Rosenhahn, H. Broszio: "RoadSaW: A Large-Scale Dataset for Camera-Based Road Surface and Wetness Estimation", CVPR Workshop on Autonomous Driving, 2022, paper at CVF, paper at ieeexplore
  
  • RoadSaW demo video [youtube]
    
  • RoadSaW dataset
  • Poster [pdf]

Interaktive Werkzeuge zur automatisierten 2D/3D-Annotation – Interactive Tools for Automated 2D/3D Annotation

Development of interactive methods based on computer vision and machine learning to ease and fasten the annotation (e.g. labeling) of vision data.
The objective is to generate highly accurate annotation with minimal user interaction. The annotated data serves as ground truth for machine learning approaches targeting automated driving applications.

• Demonstration video [youtube]
  
• Automated 2D/3D-Annotation Flyer

Kamerabasierte Bewegungsanalyse aller Verkehrsteilnehmer für automatisiertes Fahren – Camera-based Motion Analysis of Road Users for Automated Driving

This project addresses motion estimation of road users, e.g., cars and pedestrians, using monocular image sequences. To achieve that, panoptic segmentation is applied to each camera image to extract object instances of road users. Then, 3D information (position, orientation, and shape) of detected road users is estimated. Detected object instances are associated across frames by fusing their spatial consistency in 2D and 3D. The result is the motion of all detected road users, which is fundamental for the planning phase of automated driving.

Dieses Projekt wurde mit Mitteln des Europäischen Fonds für regionale Entwicklung gefördert. – This project was partially funded by the European Fund for Regional Development.

For the products VooCAT/CineCAT, various algorithms for camera calibration, tracking, structure from motion, and video segmentation are developed. The basis for the scene estimation is the usage of corresponding image features which arise from a 3D structure being mapped to different camera image planes. By using a statistical error model which describes the errors in the position of the detected feature points, a Maximum Likelihood estimator can be formulated that simultaneously estimates the camera parameters and the 3D positions of the image features.

The camera path, the video segmentation, and the reconstructed scene are essential for the integration virtual objects into the video. The point cloud is used for 3D measurements, such as distances to or between different objects of the scene.

Published Videos:

• Example augmentation results video
• 3D reconstruction from monocular video
• Tutorial video

Recent Publications:

• K. Cordes, H. Broszio: "Micro Maneuvers: Obstacle Detection for Standing Vehicles using Monocular Camera", IEEE 25th International Conference on Intelligent Transportation Systems (ITSC), pp. 3861-3866, 2022
  Demonstration Video [YouTube]
  Presentation slides (pdf)
  Paper at ieeexplore

• "Method for detecting curbs in the vehicle environment", ("Verfahren zur Erfassung von im Fahrzeugumfeld befindlichen Bordsteinen"), Maciej Korzec, Hellward Broszio, Matthias Narroschke, Nikolaus Meine, DE102016215840A1, 2018-03-01
• "Method of inherent shadow recognition", ("Verfahren zur Eigenschattenerkennung"), Daniel Liebehenschel, Maciej Korzec, Hellward Broszio, Kai Cordes, Carolin Last, DE102016216462A1, 2018-03-01
• "Method for continuous estimation of driving surface plane of motor vehicle",  ("Verfahren und Vorrichtung zur Schätzung einer Fahrbahnebene und zur Klassifikation von 3D-Punkten"), Andreas Haja, Hellward Broszio, Nikolaus Meine, DE102011118171A1, 2013-05-16
• "Method for determining e.g. wall in rear area of passenger car during parking", ("Verahren zur Bestimmung von Objekten in einer Umgebung eines Fahrzeugs"), Andreas Haja, Hellward Broszio, Nikolaus Meine, DE102011113099A1, 2013-03-14
• "Method for determining angle between towing vehicle and trailer", ("Verfahren und Vorrichtung zur Bestimmung eines Winkels zwischen einem Zugfahrzeug und einem daran gekoppelten Anhänger"), Andreas Haja, Hellward Broszio, Nikolaus Meine, DE102011113197A1, 2013-03-14
• "Method for detecting obstacle in car surroundings", ("Verfahren und Vorrichtung zur Detektion mindestens eines Hindernisses in einem Fahrzeugumfeld"),  Hellward Broszio, Andreas Haja, Nikolaus Meine, DE102010009620A1, 2011-09-01

• IdenT Flyer
• Research project „IdenT“: focus on autonomous driving
• Forschungsprojekt „IdenT“: autonomes Fahren im Fokus
• IdenT – Forschungsprojekt zum autonomen Transport der Zukunft

Ressourcenadaptive Szenenanalyse und -rekonstruktion – Resource-adaptive scene analysis and reconstruction

Project Website:

• https://5gcar.eu/

Project Flyer:

• 5GCAR Flyer

Published Videos:

• 5GCAR final demonstration
• 5GCAR Pre-demonstration (demo video for MWC 2019)
• Explanation of 5GCAR use cases (demo video for MWC 2018)

Publications:

• K. Cordes, H. Broszio, H Wymeersch, S Saur, F Wen, Nil Garcia, Hyowon Kim: "Radio‐Based Positioning and Video‐Based Positioning",
  https://doi.org/10.1002/9781119692676.ch8, Wiley, April 2021
  Book Chapter at ieeexplore
  

• K. Cordes and H. Broszio: "Vehicle Lane Merge Visual Benchmark",
  International Conference on Pattern Recognition (ICPR), IEEE, pp. 715-722, 2021
  Supplementary Video , Poster , Benchmark,
  Paper at ieeexplore

• K. Antonakoglou, N. Brahmi, T. Abbas, A.E. Fernandez Barciela, M. Boban, K. Cordes, M. Fallgren, L. Gallo, A. Kousaridas, Z. Li, T. Mahmoodi, E. Ström, W. Sun, T. Svensson, G. Vivier, J. Alonso-Zarate: "On the Needs and Requirements Arising from Connected and Automated Driving",  J. Sens. Actuator Netw. 2020, 9(2):24.
  OpenAccess: abstract, html, pdf

• K. Cordes, N.Nolte, N. Meine, and H. Broszio: "Accuracy Evaluation of Camera-based Vehicle Localization", International Conference on Connected Vehicles and Expo (ICCVE), IEEE, pp. 1-7, Nov. 2019
  Paper at ieeexplore

• "The 5GCAR Demonstrations", Sep. 2019
  Deliverable D5.2 (pdf)

• B. Cellarius, K. Cordes, T. Frye, S. Saur, J. Otterbach, M. Lefebvre,  F. Gardes, J. Tiphène, M. Fallgren: "Use Case Representations of Connected and Automated Driving", European Conference on Networks and Communications (EuCNC), June 2019
  Extended abstract (pdf)         Poster (pdf)

• K. Cordes and H. Broszio: "Constrained Multi Camera Calibration for Lane Merge Observation",  International Conference on Computer Vision Theory and Applications (VISAPP), SciTePress, pp. 529-536, Feb. 2019
  Paper preprint (pdf)    Poster (pdf)

• "5GCAR Demonstration Guidelines", May 2018
  Deliverable D5.1 (pdf)
• M. Fallgren, M. Dillinger, A. Servel, Z. Li, B. Villeforceix, T. Abbas, N. Brahmi, P. Cuer, T. Svensson, F. Sanchez, J. Alonso-Zarate, T. Mahmoodi, G. Vivier, M. Narroschke: "On the Fifth Generation Communication Automotive Research and Innovation Project 5GCAR - The Vehicular 5G PPP Phase 2 Project",
  European Conference on Networks and Communications (EuCNC), June 2017
  Extended abstract (pdf)
  

For the estimation of motion models of moving objects in video, a motion segmentation technique is utilized. Motion segmentation is the task of classifying the feature trajectories in an image sequence to different motions. Hypergraph based approaches use a specific graph to incorporate higher order similarities for the estimation of motion clusters. They follow the concept of hypothesis generation and validation.
Our approach uses a simple but effective model for incorporating motion-coherent affinities. The hypotheses generated from the resulting hypergraph lead to a significant decrease of the segmentation error.

Recent Publications:

• K. Cordes, C. Ray’onaldo, H. Broszio: "Motion-Coherent Affinities for Hypergraph Based Motion Segmentation",
  International Conference on Computer Analysis of Images and Patterns (CAIP), Springer LNCS volume 10424, pp. 121-132, August 2017
  Paper preprint (pdf)      Presentation slides (pdf)