Jahresbericht 2017

Jahresbericht 2017_2018

Table of Content
Preface
Autonomous underwater vehicles
Modular Drone Detection and Assistance System
Cybersecurity Training Lab
ML4P - Machine Learning for Production
Farewell to Dr. Reinhard Ebert
The Institute in Profile
Business Units
Automation
Energy, Water and Environment
Visual Inspection
Defense
Security
Core Competences and Department Portfolios
Optronics
System Technologies
Image Exploitation
Appendix: Names, Dates, Events
Advisory Board
Honors and Awards
Patents and Trademarks
Scientific Publications

FRAUNHOFER IOSB IN A NUTSHELL Development of innovative cameras. Optimal use and networking of sensors. Processing and analyzing the resulting data streams according to the task at hand, leading to decision support systems for humans or intelligent control mechanisms for autonomous systems. This comprehensive process and exploitation chain, which comprises and combines the core competences Optronics, System Technologies and Image Exploitation, is our domain at Fraunhofer IOSB. Our expertise comes to use in areas as diverse as automation, inspection or security. Like the Fraunhofer-Gesellschaft as a whole, we are committed to application-oriented research for the benefit of society and economy. We shape the future. Scientific and technological excellence are just as much a part of our DNA as customer orientation and reliability towards our clients from industry and public authorities. Funding Industrial sector 36,7% Public sector 24,6% Others 5,9% Basic funding 32,8% Staff Full-time positions 500 400 300 200 100 Business expenses 60 50 40 30 20 10 13 14 15 16 17 13 14 15 16 17 Personnel in total Scientists / engineers Others Investment Research expenditure

Preface Highlight Activities Autonomous underwater vehicles Modular Drone Detection and Assistance System Cybersecurity Training Lab / Branch Lab Görlitz ML4P – Machine Learning for Production Farewell to Dr. Reinhard Ebert The Institute in Profile Business Units and Respective Project Reports Automation Energy, Water and Environment Visual Inspection Defense Security Core Competences and Department Portfolios Optronics System Technologies Image Exploitation Appendix: Names, Dates, Events Advisory Board Honors and Awards Patents and Trademarks Scientific Publications 2 4 6 8 10 12 14 30 44 54 62 76 82 92 106 121 124 132 142

P R E F A C E P R E F A C E Prof. Dr.-Ing. habil. Prof. Dr.-Ing. habil. Jürgen Beyerer Jürgen Beyerer Dear reader, growth, in itself, is not an objective for us. As an established Fraunhofer institute, we strive for excellence in research, for substantial technological advance in our fields of competence and for maximum satisfaction on behalf of our customers in economy and administration. In order to reach these goals, we need to procure the necessary resources, generate industry orders and find the right partners. If, however, following this agenda, our staff and budget numbers rise, this is not unwelcome: it is an indicator that we are successful, that we are doing things right. Therefore, I am pleased to announce that our budget and personnel have been growing continuously for years now, reaching 52 million Euros and 518 regular staff, respectively, in 2017. Still, looking at specific topics and developments remains much more exciting than overall numbers. This is why in this (bi-)annual report we want to provide an in-depth overview with regard to projects, activities, department portfolios, and, last not least, noteworthy events and news – like the success of our “Arggonauts” team, which has reached the finals of the seven million dollar Shell Ocean Discovery XPRIZE competition. Other examples include the retrieval of a test model of the historic Canadian fighter jet “Avro Arrow” in Lake Ontario with the help of our DEDAVE underwater vehicle and the start of the Fraunhofer Lighthouse Project ML4P headed by Fraunhofer IOSB. These stories you will find in the “Highlights” section right at the beginning, followed by our institute’s profile and comprehensive presen- tations of our business units and departments. Optronics, System Technologies and Image Exploitation remain our identity-defining core competences. This combination makes us a sought-after partner all along a comprehensive process chain – from devising, characterizing and networking sensors over processing, analyzing and making sense of the resulting data streams to creating intelligent autonomous control mechanisms and decision support systems, including innovative human-machine interaction concepts. A multitude of diverse and fascinating projects arises from this unique competence profile, as you will see in our business units section, starting on page 28 – albeit we had to limit ourselves to a small selection of the actual ongoing projects. 2

There are some important news to report concerning the extended managing circle of the institute and its ties to the local universities: • Our long-standing quest to create a chair for Optronics at the Faculty of Electrical Engineer- ing and Information Technology of the Karlsruhe Institute of Technology (KIT) has been crowned with success: I am very pleased to announce that Dr. rer. nat. Marc Eichhorn has been appointed KIT Professor of Optronics as of April 1st, 2018. At the same date, he has taken office as head of division at our site in Ettlingen. • Prior to this, at the end of 2017 we had to say goodbye and farewell to Marc Eichhorn’s predecessor as head of division “Optronics and Photonic Systems” in Ettlingen, Dr. rer. nat. Reinhard Ebert. He worked for us with great commitment until long after the regular age of retirement. We are very grateful for his ongoing dedication, now as an external advisor to the Institute. • Dr.-Ing. Peter Bretschneider, head of department at our Ilmenau branch for Applied System Technologies IOSB-AST, has been appointed Professor of Energy Usage Optimization at the Ilmenau University of Technology in November 2016. • IOSB-AST has founded a new branch lab in the city of Görlitz, thus establishing a close connection with the local University of Applied Sciences Zittau-Görlitz (cf. page 9). • With respect to our Lemgo branch for Industrial Automation IOSB-INA, the efforts of creating a professorship for Cognitive Automation at Bielefeld University are well underway. We expect to appoint an appropriate candidate in the second half of 2018. Our special thanks goes to our partners and clients in business, in government and in the ministries, and to all of Fraunhofer IOSB’s sponsors and advisors. Without the reliable support and cooperation of the federal ministries of Education and Research (BMBF) and of Defense (BMVg) we would not be able to carry out our activities and fulfil our mission. Our gratitude also extends to the employees of IOSB and their excellent work. Their expertise, skills, diligence and academic motivation are the cornerstone of our institute’s success. Karlsruhe, Ettlingen, Ilmenau, Lemgo and Görlitz, April 2018 Prof. Dr.-Ing. habil. Jürgen Beyerer 3

H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S AUTONOMOUS UNDERWATER VEHICLES COM- PETE FOR THE OCEAN DISCOVERY XPRIZE To advance human achievement in areas where technology currently offers no clear solutions: this is the aim of several large, ambitious innovation competitions which have enjoyed a renais- sance over recent years. From DARPA Challenges to EU Innovation Prizes and the competitions run by California’s XPRIZE Foundation – these schemes seek to stimulate innovative ideas with the potential to spawn new industries and new jobs. The Shell Ocean Discovery XPRIZE launched in 2016 is one example. The “ARGGONAUTS” team at Fraunhofer IOSB has taken up the challenge. The primary task is to study the ocean floor. The final will take place in autumn 2018 with the following requirements: 250 km² of seafloor have to mapped within 24 hours – at a depth of 4000 meters. In addition, price-worthy photographs of both a specified object and other archaeological, biological or geological features must be taken. Importantly, the technology used must be essentially autonomous: no human operators are permitted on or below the ocean surface while the measurements are being performed. Finally, all the equipment required for the competition must fit into a standard shipping container. 2 Contact: Dr. Gunnar Brink Phone +49 721 6091-640 gunnar.brink@iosb.fraunhofer.de 4

1 Of the original 32 teams, 20 have been admitted to the semifinals based on their technology and finance concepts. In December 2017, we proved that our solutions meet the criteria necessary to advance to the final round. As one of the nine finalists, we hope our fleet of extremely cost-efficient submersibles and inflatable, unmanned support boats will continue to perform well and that we will be one of the top three teams in the world. 1 A “Great Diver”, one of a swarm of underwater drones developed for the XPRIZE competition. 2 The “ARGGONAUTS” presenting the trophy awarded to the finalists. 3 Found with the help of DEDAVE: A 1:8 true-to-scale model of the CF-105 on the bed of Lake Ontario. The Fraunhofer executive board generously provided a budget of over €2 million for the project. This was a great motivation – for a difficult challenge. In just ten months, we had to develop a completely new concept for previously unsolved problems. We had to build a team, select, order and assemble components and sensors, program software and test every- thing. All these processes were governed by a framework of public procurement rules. We had our team trained in SCRUM techniques for agile development and adapted the method for hardware-intensive projects which encompass a wide range of different technologies. The investment will pay dividends even if we do not eventually win the prize of up to $5 million. Fraunhofer is gaining important experience in dealing with challenges of this nature, which we are likely to encounter more often in future. We will document our agile development methods and make them available for other teams conducting research under time pressure. We also want to found a spin-off company. Our technology has many beneficial applications – from monitoring deep-sea cables to finding wrecks and archaeological treasures or exploring the seabed for immense reserves of natural resources and using them responsibly. 3 Tracking Remains of Historic “Avro Arrow” fighter jet Another success story involving autonomous underwater vehicles centers around the DEDAVE developed by Fraunhofer IOSB-AST in Ilmenau (cf. annual report 2015 / 2016). The technology was licensed by Kraken Sonar, Inc. and made it possible to find a test model of the ultrasonic delta-wing interceptor CF-105 in Lake Ontario. The Canadian fighter jet, nicknamed “Avro Arrow”, was being developed in the 1950s. For strategic reasons, the program was abandoned. All documents and parts were destroyed. Today, interest in reconstructing details of the historic project is huge, leading to remarkable efforts to find eight true-to-scale models that had been used in flying tests over Lake Ontario. In September 2017, using DEDAVE, two were detected. The media response was tremendous: the New York Times and many other renowned media outlets reported. 5

H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S MODEAS – MODULAR DRONE DETECTION AND ASSISTANCE SYSTEM Protection of infrastructures and events against small unmanned aerial vehicles (UAVs), commonly referred to as drones, is a largely unsolved problem. In order to tackle this, Fraunhofer IOSB in 2016 started the self-funded project MODEAS with the idea of creating an integrated system for the detection, localization, classification and tracking of small unmanned aerial vehicles based on a network of linked multi-sensor stations. By now, an experimental prototype exists and has attracted much attention in several demon- strations for potential customers. Depending on the version of the system selected, the modular concept can be equipped with high definition optical cameras with a 360° view, tracking units with telephoto zoom cameras, directional microphones, radio detection modules and laser range finders. The open system architecture allows additional sensors or sensor systems to be integrated as required. Moreover, it can be used to control optional defensive systems (actuators). The rapid technological development of small unmanned aerial vehicles creates new hazards and potential for abuse: drones can spy on people and property or be used to transport items over conventional perimeter fences, e.g. into prisons. If fitted with explosives or toxins, they can also cause significant damage. Protection against drone attacks of this type requires reliable detection at the earliest possible time – ideally before the drone takes off – in order to initiate appropriate countermeasures. This is the aim of the MODEAS project. One of the major challenges for drone warning systems is the avoidance of false alarms, e.g. by birds, by private, commercial or public sector drones being used legally and by manned aircraft. To overcome these challenges, MODEAS uses signals from a variety of sensors (optical, acoustic and radio) and an object database which can be updated online. This stores signatures and other relevant properties of a variety of known drone models. MODEAS also makes this reference data available to decision-makers in order to achieve rapid response times using a semi-automated decision support assistant. What we have achieved so far The MODEAS sensor system has a video-based detection range of up to 500 m around each sensor station. Detection of radio communication signals can be achieved over even greater distances. When an alarm is triggered by one of the sensor systems, it is validated by imme- diately comparing it with data from the other MODEAS sensors and the object database. This prevents false alarms and ensures MODEAS offers a high level of reliability in addition to excel- lent locating performance. Linking stations allows the system to cover the entire perimeter of a property and process several aerial vehicles simultaneously. Contact: Dr.-Ing. Igor Tchouchenkov Phone +49 721 6091-552 igor.tchouchenkov@ iosb.fraunhofer.de 6

1 2 1 The MODEAS sensor-array, including a microphone, a laser range finder, detection and tracking video cameras and radio antennas. 2 Typical quadrocopter drone. MODEAS offers the following key features: • fast, multi-sensor detection and classification, • multi-object capability, • fusion of data and information from various sources, • online, updateable object databases, • decision support, • archiving of relevant information, • scalability, • automatic networking, • intuitive user interface, • simple integration of additional sensors, • interoperability with other systems. Project details MODEAS is a research project conducted by Fraunhofer IOSB involving about 40 researchers. They are developing hardware and software alike. The project focuses on processes and algorithms as well as sensor components and even complete integrated systems. The concept aims at a flexible, extendible and scalable network of sensor stations with individual multi- sensor configurations that can be tailored to meet their specific requirements. By linking the stations, MODEAS can secure areas of any size including infrastructure and real estate. Furthermore, it has the capability to identify several unmanned aerial vehicles simultaneously. The functional prototype presented in 2017 is equipped with a high definition, multi-focal, optical camera system (360° view) for initial detection of UAVs, a pan-tilt tracking unit with optical zoom cameras, directional microphones, radio detection modules and laser range finders. The available sensors ensure reliable detection and accurate localization. The system also uses radio detection modules to capture communication between the UAVs and their ground station and issue an early warning regarding the potential presence of drones in the air space. Depending on the drone model, it may be possible to tap the usable data stream (downlink) or even take over the pilot controls. The open system architecture permits the integration of additional sensors specific to the task, such as radar, IR and hyperspectral cameras. On a higher level, MODEAS supports the user in evaluating threats and selecting possible responses not just through its database of the known capabilities of the detected aerial vehicle but also through situation-dependent risk analysis including assessment of the hazards which could arise through the use of available defensive measures. Literature [1] Tchouchenkov, I.; Schönbein, R.; Segor, F.: Einsatzmöglichkeiten und Abwehr kleiner unbemannter Flug- geräte. – Polizei heute, Mai/Juni 2012, S. 74-79 [2] Tchouchenkov, I.; Schönbein, R.; Kollmann, M.; Segor, F.; Bierhoff, T.; Herbold, M.: Detection, Recognition and Counter Measures Against Unwanted UAVs. – In Proc. of the 10th Future Security Research Con- ference, September 15 - 17, 2015, Berlin, pp. 333-340 [3] Tchouchenkov, I.; Schönbein, R.; Segor, F.: Detection and Protection Against Unwanted Small UAVs. - In Proc. of the Eleventh International Conference on Systems (ICONS 2016), February 21 - 25, 2016, Lisbon, Portugal, pp. 26-29 7

H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S 1 CYBERSECURITY TRAINING LAB FOR CRITICAL INFRASTRUCTURES AND FOR INDUSTRY 4.0 As society becomes increasingly digitalized, the potential threat of cyber attacks is growing rapidly. In addition to more familiar types of attack, the spotlight is now falling onto large scale attacks on critical infrastructures and industrial complexes. IT security and cybersecurity are thus a key, cross-sectional technology for ensuring that moder n society and industry continue to function. Professionally trained IT security specialists are a rare commodity in Germany. So as not to fall behind in the arms race with cyber criminals, IT teams and managers must constantly hone their skills and improve their expertise in order to stay at least one step ahead. Several Fraunhofer Institutes and universities of applied sciences are now offering a modular, part-time study program to make the results of the latest research available to professionals working in this area. Short-format events in the Cybersecurity Training Lab allow participants to gain qualifications through in-service study and combine cybersecurity modules flexibly for a variety of professional roles. These compact courses for IT teams and managers from the industrial and public sectors take place in a high quality laboratory with state-of-the-art IT infrastructure. Here, they face simulations of real threat scenarios, learn to recognize their significance and consequences and study the application and effectiveness of appropriate solution concepts in practice. Critical infrastructures / Use cases for energy and water infrastructures Fraunhofer IOSB is involved in two areas in the Cybersecurity Training Lab. One topic deals with “Smart Grid” technologies and equivalent structures for other infrastructures. It considers vulnerabilities in planning and operations, especially risk assessment and strategies for measures aimed at preventing cyber attacks. The training course is designed for planners and operators of utility networks as well as manufacturers of components and solutions. The emphasis here is on network planning and management. Contact: Dr.-Ing. Christian Haas Phone +49 721 6091-605 christian.haas@iosb.fraunhofer.de Research in this area is centered at IOSB-AST, the Applied System Technologies branch of IOSB, in Ilmenau and Görlitz (cf. “Görlitz - A New Site for Fraunhofer IOSB” below). Likewise, cybersecurity training events take place at both sites. Prof. Dr. Jörg Lässig Phone +49 3581 7925-354 joerg.laessig@iosb-ast.fraunhofer.de Industrial manufacturing / Industry 4.0 Second, the Cybersecurity Training Lab focuses on network and security technologies for automation systems with regard to networked systems, Internet connections and cloud 8

2 3 technologies for automation tasks. The training course is designed for planners and operators of automation systems as well as developers of automation solutions. On the user side, target groups include all sectors of manufacturing industry and manufacturers of automation solutions. These activities are based at the Industrial Automation branch IOSB-INA in Lemgo and in Karlsruhe, where the Cybersecurity Training Lab integrates with KASTEL, the cross- institutional Competence Center for Applied Security Technology funded by the Federal Ministry of Education and Research. Current training modules and dates are available at www.cybersicherheit.fraunhofer.de 1 Johanna Wanka, former German Federal Minister of Education and Research, at the inauguration of the Görlitz branch lab. 2 , 3 Cybersecurity Lab for critical infrastructures including a real grid control system. 4 Building of the University of Applied Sciences Zittau-Görlitz where the Fraunhofer IOSB branch lab is located. 4 Görlitz – A New Site for Fraunhofer IOSB Starting from December 2016, Fraunhofer IOSB has a fifth site in Germany: the branch lab Görlitz (“Außenstelle” in German wording). This site at the moment comprises one research group with the topic “Cybersecurity for critical infrastructures energy and water”, consisting of four people. The group is part of the department Energy (NRG) of IOSB. It is being lead by Prof. Dr.-Ing. Jörg Lässig, who is also professor of informatics at the University of Applied Sciences Zittau-Görlitz (HSZG). Thus, by starting the Görlitz branch lab, IOSB-AST laid the basis for a new academic partnership, creating synergies with the distinct competences of HSZG in the field of Cybersecurity. 9

H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S H I G H L I G H T A C T I V I T I E S FRAUNHOFER LIGHTHOUSE PROJECT ML4P – MACHINE LEARNING FOR PRODUCTION Machine learning and artificial intelligence are at the heart of today's technical innovations. Machine learning allows for far-reaching and unknown insights into complex systems that can no longer be grasped by human expertise. Methods of machine learning are increasingly establishing themselves in a wide variety of appli- cation domains and developing their disruptive potential there. In order to make them usable in the field of manufacturing and production processes, the Fraunhofer-Gesellschaft is funding the lead project ML4P “Machine Learning for Production”. Under the leadership of IOSB, six Fraunhofer Institutes are involved. In almost every area of society, the amount of available data is increasing at an explosive rate. So-called cyber-physical systems such as mobile devices, autonomous vehicles, intelligent sensor systems and even home automation systems generate a flood of data that has so far only been used to a limited extent. These data form the perfect basis for the use of machine learning methods. In the wake of the High-Tech Strategy Industrie 4.0 and the associated digitalisation of production, this trend also extends to industry. With production processes increasingly being equipped with sensors and actuators, huge amounts of process data are collected, making it possible to gain deep insights into the sometimes very complex physical and technical interrelationships. Contact: Dipl.-Ing. Christian Frey Phone +49 721 6091-332 christian.frey@iosb.fraunhofer.de 1 0 1

2 Disruptive potential for production plants The starting point for the ML4P project is our conviction that today's industrial production processes offer far-reaching optimization potentials that can be tapped with methods of machine learning. However, for a targeted optimization of processes, e.g. with regard to quality, process and material parameters, it is indispensable to design and implement methods of machine learning that are appropriately adapted. Then, with the help of data, unknown interrelationships can be learned, processes can be modeled and adaptive mechanisms can be implemented in order to make production plants flexible and quickly adaptable. In contrast to those application domains of machine learning in which huge amounts of data are available (Internet, social media, etc.), in the industrial context there is “only a lot” of data, but usually also some additional expert knowledge. For consistent plant optimization, both must be taken into account: all available data and the entire expert knowledge. In an industrial context, therefore, not only the trend topic of deep learning is interesting, but also a wide variety of other special machine learning methods that can also handle less data while simultaneously making use of previous knowledge. Systematic procedure for industrial applications Currently, there is still an enormous gap between the algorithms of machine learning and their successful application in manufacturing and production processes. A systematic procedure for applying machine learning methods in industrial applications is lacking, which would allow to effectively identify the optimization potential hat can be tapped. According to the extensive experience of various Fraunhofer Institutes, there is a great demand in the process and piece goods production industry, which is often accompanied by a lack of machine learning expertise on the part of the user. It is against this background that the Fraunhofer lead project ML4P was launched in January 2018. In addition to Fraunhofer IOSB and IOSB-INA, IAIS, IFF, ITWM, IWM and IWU are also involved. The task is to develop a systematic procedure for the use of adapted machine lear- ning methods in industrial applications with industry-standard tools to systematically record the relevant knowledge and data of a production plant, to appropriately select adapted machine learning procedures and to use them to full advantage. 1 Visualization of learned process behavior by unsuper- vised machine learning methods. 2 Optimization potentials beyond human grasp: production process in a smart factory. Reducing Time to Market: Fraunhofer Lighthouse Projects Fraunhofer is tackling the current challenges facing industry head on. Its light- house projects put the focus on strategic objectives with a view to developing practical solutions from which econo- mies such as Germany’s can benefit. The topics these projects address are geared towards economic requirements. By pooling their expertise and involving industrial partners at an early stage, the Fraunhofer Institutes involved in the projects aim to turn original scientific ideas into market- able products as quickly as possible. 1 1

THE INSTITUTE IN PROFILE Established on January 2010, the Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB grew to become Europe’s largest research institute in the field of image acquisition, processing and analysis. IOSB’s other areas of activity are control and automation technology, and information and knowledge management. IOSB has the same mission as its parent, the Fraunhofer-Gesellschaft. Practical usability lies at the heart of all research activities of both institutions. With its research the IOSB seeks to advance technology-driven innovation; with market analysis it seeks to advance application- driven innovation; and in cooperation with research and industry partners it supports innovation in society and industry. What makes the institute special is that it combines core know-how in optronics, system technologies, and image exploitation with application know- how gained through an extensive dialog with its partners. Core competences and structure Optronics is the interface between electromagnetic radiation and electronic signals. It deals with converting information about the appearance of the environment and the objects it contains into electrical signals and electrical signals into optical images. Image Exploitation covers con- ditioning and real-time processing of, and automatic and interactive information extraction from images and videos. System Technologies, which represent a cross-section of expertise and are essential for responding to difficult, comprehensive issues with integrated solutions, may appear to be our most abstract field of research. It covers everything that is required for analyzing, gaining an understanding of, modeling, developing, and controlling complex systems. While the three core competencies give the institute its distinctive profile, there are 15 departments to date, which constitute the basic operational units. In addition, one joint research group with the Chair for Interactive Real-Time Systems of the Institute of Anthropo- matics guarantees for close ties with the Faculty of Informatics of KIT, the Karlsruhe Institute of Technology. The Competence Triangle on the next page illustrates how each of the departments contributes to the core competences. With their various key areas, and combining a range of different scientific disciplines, the departments of IOSB cover the entire process chain from signal acquisition through signal analysis to integration into operational systems. In practical use, systems interact with their environment. This, too, is reflected by the activities of IOSB, which cover all degrees of free- dom required for effective system design. The abundance of our expertise gives us a great bandwidth of achievable goals. 1 4

T H E I N S T I T U T E I N P R O F I L E T H E I N S T I T U T E I N P R O F I L E Holistic approach While finding solutions to our tasks requires sophisticated technologies to deal with the various subproblems, the creation of value and benefit requires a well-organized interplay of powerful components in a coherent whole. Our fields of in-depth expertise include automation technology, system architecture, software engineering, network engineering, information and knowledge management, interoperability technologies and a systematic design of human-machine systems. Typical for problems beyond a certain degree of difficulty and complexity is that ideal solutions are not merely automatisms but rather human-machine systems, in which – in addition to hardware and software – the organization into an overall process is crucial. In addition to its research and development activities, IOSB has systems evaluation and assessment capabilities. With its unbiased evaluation competence, IOSB supports clients in planning and developing components and systems, in developing concepts and planning facilities, and in procurement. Business units As well as calling for scientific and technology skills, best-of-class solutions also need in-depth industry knowledge. This is why we have business units. They do not define our organizational structure, which consists of the abovementioned departments; they rather represent an overlay to that structure in order to unite the expertise of IOSB in its various markets. Our current five business units are listed below. Developing dynamically, they provide specific solutions, services and products tailored to the needs of their specific markets. The departments participate in the business units according to their activities in the respective markets. Energy, Water Automation and Environment Visual Inspection Defense Security Business Units of IOSB. 1 6

Locations Fraunhofer IOSB has five locations in Germany: Karlsruhe, Ettlingen, Ilmenau with its new branch lab Görlitz and Lemgo (cf. map on the inside back cover), as well as a representative office in Beijing. Director: Prof. Dr.-Ing. habil. Jürgen Beyerer KARLSRUHE ETTLINGEN ILMENAU / GÖRLITZ LEMGO BEIJING Division Photonics and Optronic Systems Advanced System Tech- nology (AST) Branch of Fraunhofer IOSB Industrial Automation (INA) Branch of Fraunhofer IOSB Beijing Representative Office of IOSB Departments: SPR, ILT, MRD, IAD, IAS, VID, VBV Departments: OPT, SIG, LAS, OBJ, SZA Departments: NRG, WMS Departments: DIS, MIT Head of division Prof. Dr. rer. nat. habil. Marc Eichhorn Head of AST Prof. Dr.-Ing. habil. Thomas Rauschenbach Head of INA Prof. Dr.-Ing. Jürgen Jasperneite Head of representative office Dipl.-Ing. Hong Mu Locations and branches of IOSB. Institutional ties Of great importance for the institute are its ties with the Karlsruhe Institute of Technology (KIT), which complements its research capabilities. With the Chair for Interactive Real-Time Systems at the Institute for Anthropomatics (Department of Informatics) and the newly created Chair for Optronics at the Institute of Theory and Systems Optimization in Electrical Engineer- ing (Faculty of Electrical Engineering and Information Technology), both our Karlsruhe and Ettlingen sites collaborate closely with KIT in their research work. With additional consulting activities of university chairs at IOSB, the membership of university professors in the Board of Trustees, lecturing by IOSB staff and more, cooperation with KIT is multi-faceted. At IOSB’s Lemgo site, besides two professorships at Ostwestfalen-Lippe University of Applied Sciences, a new Chair for Cognitive Automation, to be appointed in the second half of 2018, will establish a new cooperation with Bielefeld University. In Ilmenau, the ties with the local University of Technology have been intensified by the creation of the professorship for Energy Usage Optimization. In addition, with the creation of the branch lab in Görlitz linked to a professorship for Informatics, a new partnership with the University of Applied Sciences Zittau-Görlitz (HSZG) is in place. 1 7

O V E R V I E W O V E R V I E W ORGANIZATION CHART Director Director Prof. Dr.-Ing. habil. Prof. Dr.-Ing. habil. Jürgen Beyerer Jürgen Beyerer Deputies to the Director Prof. Dr. rer. nat. habil. Marc Eichhorn Dr. rer. nat. Jürgen Geisler Dr.-Ing. Olaf Sauer OPTRONICS SYSTEM TECHNOLOGIES HEAD OF ADVANCED SYSTEM TECHNOLOGY (AST) BRANCH OF FRAUNHOFER IOSB HEAD OF INDUSTRIAL AUTOMATION (INA) BRANCH OF FRAUNHOFER IOSB Head of department OPT Optronics Dr. rer. nat. Dipl.-Chem. Helge Bürsing Phone +49 7243 992-446 Head of department SPR Visual Inspection Systems Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 Head of department WMS Water and Mobile Systems Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 Head of department DIS Digital Infrastructure Prof. Dr.-Ing. Jürgen Jasperneite Phone +49 5261 94290-22 Head of department SIG Signatorics Dr. rer. nat. Karin Stein Phone +49 7243 992-114 Head of department NRG Energy Prof. Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 Head of department MIT Machine Intelligence Prof. Dr.-Ing. Oliver Niggemann Phone +49 5261 94290-42 Head of department LAS Laser Technology Dr. Christelle Kieleck Phone +49 7243 992-310 1 8 Head of department ILT Information Management and Production Control Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 Head of department MRD Systems for Measurement, Control and Diagnosis Dip.-Ing. Christian Frey Phone +49 721 6091-332

IMAGE EXPLOITATION DIVISION: Head of department IAD Interactive Analysis and Diagnosis Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 721 6091-393 Head of department SZA Scene Analysis Dr.-Ing. Karsten Schulz Phone +49 7243 992-106 Head of department IAS Interoperability and Assistance Systems Dr.-Ing. Rainer Schönbein Phone +49 721 6091-248 Head of department VID Video Exploitation Systems Dr.-Ing. Markus Müller Phone +49 721 6091-250 Head of department OBJ Object Recognition Dr. rer. nat. Michael Arens Phone +49 7243 992-147 Group manager VBV Variable Image Acquisition and Processing (Research Group) Dr.-Ing. Miro Taphanel Phone +49 721 6091-389 PHOTONICS AND OPTRONIC SYSTEMS Strategy and Innovation Management Dr. Gunnar Brink Phone +49 721 6091-640 Public Relations Dipl.-Phys. Ulrich Pontes Phone +49 721 6091-300 Commercial and Technical Management Dipl.-Kaufm. Siegbert Böckle Phone +49 721 6091-350 Head of division since 1.4.2018 Prof. Dr. rer. nat. Marc Eichhorn Phone +49 7243 992-210 marc.eichhorn@iosb.fraunhofer.de Assigned departments Optronics Dr. rer. nat. Dipl.-Chem. Helge Bürsing Signatorics Dr. rer. nat. Karin Stein Object Recognition Dr. rer. nat. Michael Arens Scene Analysis Dr.-Ing. Karsten Schulz Representative Office China, Beijing Dipl.-Ing. Hong Mu Phone +86 10 65900 621 1 9

CONTACT OFFICE CHINA, BEIJING 1 Many German companies have discovered China as an attractive market. However, these companies often also need local partners in applied research. Due to a long-term cooperation with several research institutes and industrial partners in China, Fraunhofer IOSB established a representative office in Beijing as early as in 1996. 1 Underwater vehicle for water quality monitoring at the Beijing Water Science and Technology Institute. The focus of the representative office is the initiation of research activities focused on the areas of environment and energy. Especially in the field of water supply and water resource management, Fraunhofer IOSB is involved in many R&D projects in China. 2016 and 2017 were very successful years for the cooperation with China. We could acquire several projects with partners in China. Some examples are as follows: • solutions for wireless data transmission of water quality data • condition monitoring for wind turbines • development of two remotely operated underwater vehicles (ROVs) for water quality monitoring and observations of reservoirs and aquacultures As part of the funding program “International Partnerships for Sustainable Technologies and Services for Climate Protection and the Environment“ (CLIENT), the research project “HAPPI“ (Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by Smart Technologies) has been extended for another year by the BMBF because of the very successful research results in this project. During this additional year, the innovations of the HAPPI project will be integrated in the design process of a new cascade of small hydropower plants in the Southwest of China. Another major water project, the EU project INAPRO (Innovative model and demonstration based water management for resource efficiency in integrated multitrophic agriculture and aquaculture system) could be continued. The competence of Fraunhofer IOSB in the field of Industry 4.0 is highly appreciated by Chinese researchers and companies. That is why several training courses were organized in Germany. Furthermore, the exchange of scientists between China and Germany could be strengthened: visiting professors of the China Agriculture University and the Beijing Water Science and Technology Institute, delegations from the China Institute of Water Resources and Hydro- power Research as well as from the National Deep Sea Center in Qingdao were welcomed to Germany. 2 0 Dipl.-Ing. Hong Mu Phone +86 10 65900 621 Fax +86 10 65900 619 muh@fraunhofer.com.cn Fraunhofer Representative Office Beijing Representative for Production and Information Technologies Unit 0610 Landmark Tower II 8 North Dongsanhuan Road Chaoyang District 100004 Beijing, PR China Contacting us in Germany Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 thomas.rauschenbach@ iosb-ast.fraunhofer.de

IOSB'S UMBRELLA ORGANIZATION: FRAUNHOFER-GESELLSCHAFT Research of practical utility lies at the heart of all activities pursued by the Fraunhofer-Gesellschaft. Founded in 1949, the research organization under- takes applied research that drives economic development and serves the wider benefit of society. Its services are solicited by customers and contractual part- ners in industry, the service sector and public administration. At present, the Fraunhofer-Gesellschaft maintains 72 institutes and research units. The majority of the more than 25 000 staff are qualified scientists and engineers, who work with an annual research budget of 2.3 billion euros. Of this sum, almost 2 billion euros is generated through contract research. Around 70 percent of the Fraunhofer-Gesellschaft’s contract research revenue is derived from contracts with industry and from publicly financed research projects. Around 30 percent is contributed by the German federal and state governments in the form of base funding, enabling the institutes to work ahead on solutions to problems that will not become acutely relevant to industry and society until five or ten years from now. International collaborations with excellent research partners and innovative companies around the world ensure direct access to regions of the greatest importance to present and future scientific progress and economic development. With its clearly defined mission of application-oriented research and its focus on key technologies of relevance to the future, the Fraunhofer-Gesellschaft plays a prominent role in the German and European innovation process. Applied research has a knock-on effect that extends beyond the direct benefits perceived by the customer: Through their research and development work, the Fraunhofer Institutes help to reinforce the competitive strength of the economy in their local region, and throughout Germany and Europe. They do so by promoting innovation, strengthening the technological base, improving the acceptance of new technologies, and helping to train the urgently needed future generation of scientists and engineers. As an employer, the Fraunhofer-Gesellschaft offers its staff the opportunity to develop the professional and personal skills that will allow them to take up positions of responsibility within their institute, at universities, in industry and in society. Students who choose to work on projects at the Fraunhofer Institutes have excellent prospects of starting and developing a career in industry by virtue of the practical training and experience they have acquired. For an overview of all Fraunhofer locations in Germany see inside back cover. The Fraunhofer-Gesellschaft is a recognized non-profit organization that takes its name from Joseph von Fraunhofer (1787–1826), the illustrious Munich researcher, inventor and entrepreneur. more at: www.fraunhofer.de 2 1

IOSB AS PART OF FRAUNHOFER GROUPS AND ALLIANCES FRAUNHOFER GROUP FOR DEFENSE AND SECURITY (VVS) The Fraunhofer Group for Defense and Security VVS was founded in 2002 and is chaired by Prof. Dr. Jürgen Beyerer. The total budget of the Fraunhofer Group amounts to approximately 430 million euros per annum, and more than 3700 employees work for the nine VVS institutes. The group considers its main objectives as follows: 1. Research and development of new technologies and solutions for the protection of people and the security of infrastructures 2. Research for national defense Being committed to the German Federal Ministry of Education and Research (BMBF) and the German Federal Ministry of Defense (BMVg), Fraunhofer VVS has come to assert itself as the driving force in the entire defense and security sector. Even on a European level, Fraunhofer VVS represents one of the key players and facilitates intensive networking with promising collaborative research activities. Through excellent performance, the Fraunhofer-Gesellschaft significantly con- tributes to the future strategic orientation of the European security- and defense-research program. Core competences The fields of application can be assigned to defense research on the one hand, and civil security research on the other hand. Fraunhofer VVS’s core competences are: • Defense research 4-D (land, air, water, and cyber) • Security research (protection of people and security of infrastructures, crisis management) • Technology development (microelectronic, materials, components, information and communication technology) • Testing and assessment of operational procedures • Modeling and simulation • Multidimensional security research from a technical, social, economic and political perspective Portfolio Security is an issue of growing social importance. Threats posed by terrorism operating internationally, organized economic crime, major accidents or extreme weather events represent a continuing challenge. In the Fraunhofer Group for Defense and Security VVS, nine Fraunhofer Institutes have joined forces in order to face these challenges. As centers of excellence, they create intelligent and comprehensive solutions both for civil security as well as for defense in order to improve the protection of society against manmade and natural threats. By pooling expertise and research activities, Fraunhofer VVS develops cutting edge technology and the accompanying concepts concerning methods, processes and tactics which are essential for facing the whole spectrum of potential and emerging security threats appropriately. As a result, the Fraunhofer Group is conducting research in the following business segments: • Protection of critical infrastructures • Management of crises and disasters • Cyber security and defense • Protection and effects • Reconnaissance and surveillance • Energetic materials processing and security technology • Communication and information • Command, control and operation • Decision-making support for government and economy 2 2

VVS Management Group Chairman: Prof. Dr.-Ing. habil. Jürgen Beyerer, Fraunhofer IOSB Group Deputy Chairman: Prof. Dr. rer. nat Peter Martini, Fraunhofer FKIE Managing Director: Dipl.-Ing. (FH) Caroline Schweitzer, Fraunhofer IOSB, caroline.schweitzer@iosb.fraunhofer.de Members • Fraunhofer Institute for Applied Solid State Physics IAF, Freiburg • Fraunhofer Institute for Chemical Technology ICT, Pfinztal • Fraunhofer Institute for High Frequency Physics and Radar Techniques FHR, Wachtberg • Fraunhofer Institute for Communication, Information Processing and Ergonomics FKIE, Wachtberg • Fraunhofer Institute for High-Speed Dynamics, Ernst-Mach-Institut EMI, Freiburg • Fraunhofer Institute for Technological Trend Analysis INT, Euskirchen • Fraunhofer Institute for Optronics, System Technologies and Image Exploitation IOSB, Karlsruhe Associated Institutes • Fraunhofer Institute for Integrated Circuits IIS, Erlangen • Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut HHI, Berlin 2 3

I O S B A S P A R T O F F R A U N H O F E R G R O U P S A N D A L L I A N C E S Fraunhofer Information and Communication Technology Group As the largest ICT research group in Europe, the Fraunhofer Information and Communication Technology Group serves as a one-stop shop for industrial customers and media enterprises. The strengths of the member institutes are pooled strategically and marketed jointly. This network makes it possible to translate application-oriented research into customized, integrated solutions for a specific sector: • tailored IT solutions • competent consulting on technological issues • pre-competitive research for new products and services Business areas: • Digital media • E-Business • E-Government • Communication systems • Energy and Sustainability • Medicine • Production • Security • Financial service provider • Automotive Regular economy summits unite the right partners from industry and research. The Fraunhofer Information and Communication Technology Group evolves strategies and visions for medium- term priority research areas, providing its member institutes with assistance in the transfer of technology and the marketing of their research activities. The ICT Group also publishes the economy magazine »InnoVisions«, which is available at the kiosk. Contact at IOSB: Prof. Dr.-Ing. habil. Jürgen Beyerer Fraunhofer Group for Production The Fraunhofer Group for Production is a cooperative venture by a number of Fraunhofer Institutes, created with the aim of collaborating on production-oriented research and devel- opment in order to be able to offer customers in the manufacturing, commercial and service sectors comprehensive single-source solutions derived from the pooling of the wide-ranging expertise and experience of the individual institutes. The Fraunhofer Group for Production makes use of the latest findings in industrial engineering and information science to offer a range of services that covers the entire product life cycle or value chain. Business areas: • Product development • Manufacturing technologies • Manufacturing systems • Production processes • Production organization • Logistics Contact at IOSB: Dr.-Ing. Olaf Sauer 2 4

Fraunhofer AutoMOBILE Production Alliance Carmakers, their suppliers, and those equipping the automotive industry, represent a decisive economic factor in Germany. Significant changes to the entire concept of mobility are ulti- mately being driven by global trends, such as dwindling natural resources, an increasing need for mobility, urbanization and megacities. In addition, German carmakers and their suppliers are facing increasingly tough competition as the trend towards low-cost vehicles takes hold. The Fraunhofer Alliance pools the expertise of 15 institutes, who collectively provide the German automotive industry with a competent single-source partner for its research and development needs. The complementary effect achieved by combining the individual institutes' key areas of research, makes it possible to generate rapid, integrated and sustainable innova- tions along the entire process chain of vehicle manufacturing – from the planning stage right through to the finished vehicle. The Alliance tackles the challenges posed by environmental policies (reducing fuel consumption and CO2; electromobility; cutting material consumption) while taking full account of commercial imperatives (ongoing pressure to cut costs). Fraunhofer Big Data Alliance Big Data is the term used to describe large volumes of all kinds of data that accumulates rapidly: every day, all over the world, in companies and urban infrastructures, on the web and even in private households. According to forecasts, the volume doubles every two years. Processing and analyzing these vast volumes of data is a key technology for high-tech coun- tries. Worldwide, companies expect Big Data will secure strategic competitive advantages as well as boost turnover and productivity. The Fraunhofer Big Data Alliance provides support from a single source across all sectors and areas of business. Using their many years of experience in analyzing large volumes of data, the individual Fraunhofer Institutes help companies build expertise and to work up solutions that can then be applied to traditional business processes, production and logistics, and also to research and product development. We place feasibility and profitability on equal footing with data protection and security. Business fields: • Powertrain and running gear • Electric mobility • Planning, control and logistics • Car body • Vehicle assembly • Vehicle interior Contact at IOSB: Dr.-Ing. Olaf Sauer Business areas: • Logistics and mobility • Production / Industry 4.0 • Life Sciences and health care • Data security • Energy and environment • Business and finances Contact at IOSB: Prof. Dr.-Ing. habil. Jürgen Beyerer 2 5

Fraunhofer Energy Alliance The Fraunhofer Energy Alliance is one of Europe's largest energy research organizations. At our 18 member institutes in Germany and the USA, over 2000 employees conduct research on Renewable Energies, Energy Efficiency Technologies, Intelligent Energy Networks, Digitalization of the Energy Industry, Energy Storage as well as Buildings and Components. Our objective is to provide our customers with products at the system level which have particularly high investment security, future-orientation and competitive strength. Business areas: • Renewable Energy • Energy Efficiency • Energy System • Energy Storage • Energy in digital context • Energy in urban context Small and medium-sized companies as well as general industry and the energy industry are given access to a wide spectrum of research and development possibilities in order to be successful with innovative products and to acquire new markets. Here the entire range of expertise comes from a single source. The Fraunhofer Energy Alliance also provides this expertise in its function as a consultant to political and societal players and institutions. Deputy Spokesman Dr.-Ing. Peter Bretschneider All our activities focus on the objective of achieving sustainable, secure, economical and socially responsible energy supplies. Contact at IOSB: Dr.-Ing. Peter Bretschneider Fraunhofer Food Chain Management Alliance Food Chain Management (FCM) focuses on the chain of food manufacturing as an integral process-extending from the primary production via processing and trade until it reaches the consumers. The aim is to analyze and optimize these processes in order to finally supply consumers with qualitatively spotless food as efficiently and reliably as possible. Thematic areas: • Food chemistry • Food packaging technology • Logistics • Microsystem technology The Fraunhofer “Food Chain Management” Alliance aims at introducing latest scientific know- how in new products and solutions of this field by means of mutual projects. For this purpose, the platform Food Chain Management of the Fraunhofer Gesellschaft shall merge the expertise of all partners, i.e. a total of 10 institutes. Contact at IOSB: Dipl.-Ing., Dipl.-Wirt. Ing. Henning Schulte Prof. Dr.-Ing. Thomas Längle Fraunhofer Vision Alliance The Fraunhofer Vision Alliance combines the expertise of institutes in the field of image processing. The main office in Fürth serves as the initial point of contact for customers. This office is also responsible for the coordination of joint projects. The allianced institutes offer services relating to applications of innovative sensors, from infrared to x-ray, plus the associated handling apparatus. Their work focuses particularly on optical sensing and automated inspection processes for quality assurance. Business areas: • Industrial image processing • 3D surveying • Thermography • X-ray technology • Surface inspection • Medical engineering • Safety engineering • Traffic engineering • Terahertz tomography Contact at IOSB: Prof. Dr.-Ing. Thomas Längle 2 6

Fraunhofer Water Systems Alliance Business areas: • Urban/periurban water management systems In the Fraunhofer Water Systems Alliance (SysWasser) eleven Fraunhofer Institutes have been pooling their expertise in the research and development of effective water infrastructure systems and technology. • Processes and systems for the sup- ply with drinking and service water • Wastewater treatment processes The alliance’s objective is to take sustainable solutions for water catchment, infrastructure, and wastewater treatment and adapt them for use in practical applications on a national and international level, taking into consideration the relevant social, economic and environmental implications. • Integrated water resource management (IWRM) • Analysis and evaluation of water-economic systems and systems The use of an integrated, systemic approach linking the energy, waste management and agricultural sectors will contribute towards a more efficient and environmentally compatible usage of water as a life-essential resource. Spokesman: Prof. Dr.-Ing. habil. Thomas Rauschenbach Fraunhofer Space Alliance Bringing together 15 institutes, the Fraunhofer Space Alliance conducts applied research in the field of industrial space technology. Weather forecasts, navigation, real-time transmission for satellite TV or global Internet access – space industry applications and services have become an indispensable part of daily life, underpinning the importance of space technology for a modern industrialized society. In the Fraunhofer Space Alliance, the institutes pool their technological expertise in order to provide the industry and funding agencies such as the European Space Agency (ESA) and the European Commission with a central contact. Contact at IOSB: Prof. Dr.-Ing. habil. Thomas Rauschenbach Business areas: • Communication and navigation • Materials and processes • Energy and electronics • Surfaces and optical systems • Protection technology and reliability • Sensor systems and analysis Fraunhofer acts as systems provider, developing a wide range of top-quality components, integrating them into an overall system and delivering that system to the customer. The sheer technological variety of the participating institutes enables the Fraunhofer Space Alliance to offer its customers a unique range of services. Its business units are Communication and Navigation, Materials and Processes, Energy and Electronics, Surfaces and Optical Systems, Protection Technology and Reliability and Sensor Systems and Analysis. Contact at IOSB: Dipl.-Ing. (FH) Caroline Schweitzer Dr. rer. nat. Dipl.-Phys. Karin Stein 2 7

A U T O M A T I O N E N E R G Y , W A T E R A N D E N V I R O N M E N T V I S U A L I N S P E C T I O N D E F E N S E S E C U R I T Y 3 0 4 4 5 4 6 2 7 6 2 9

B U S I N E S S U N I T B U S I N E S S U N I T AUTOMATION Spokesperson Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 Business Unit Development Dr.-Ing. Olaf Sauer Phone +49 721 6091-477 Real-time ICT for complex manufacturing processes Automation technology is a key factor for the competitive- ness of the German manufacturing industry. Automation – and particularly industrial information technology – also plays a major role in the current debate about cyber-physical systems and the Internet of Things: Information and commu- nication technology (ICT) penetrates all devices, machinery and equipment in production, on all hierarchical levels, ranging from sensors and machine components, machines and their controls to IoT-platforms, interlinked plants and their visualization across operations by means of monitoring and control technology. Industrial ICT has to fulfill high standards, 3 0 which result from competitive production costs, high equip- ment availability, required product quality and guaranteed delivery times. Mechanical engineers, computer scientists and automation experts must therefore cooperate more closely than ever to meet future requirements. That is what the team of the Automation Business Unit stands for. To date, ICT in production technology has been based on the architectural model of the automation pyramid. Owing to increasing ICT support on all hierarchical levels of the factory, however, there seems to be a new trend according to which the information flow in factories follows the new ”reference architecture model for Industrie 4.0 (RAMI 4.0)”. This model takes account of three dimensions of layers comprising architectural aspects, hierarchy levels and integration spanning the entire life cycle of production equipment. When it comes to enabling shop-floor-related ICT systems to communicate consistently within the three aforementioned dimensions, for example, it is necessary to connect them systematically with the systems of the digital factory (life cycle dimension) and with automation technology on the control and field levels (vertical integration). To this end, it is indispensable to use unified, general syntax and semantics. Specifically, the activities of the Automation Business Unit focus on the following areas: 1) Manufacturing Execution Systems and production moni- toring and control systems: MES functions will be crucial for tomorrow’s IoT architectures. Real time monitoring and control systems become increasingly important for transparent and safe production. 2) Industrial standards for interoperable products and IT systems: Adaptivity is one of the key requirements for the factory of the future – not just in physical terms, but increas- ingly in terms of software, too. Our current activities in the field of PLUGandWORK are game changing in this respect. 3) Process intelligence and quality improvement by data analytics and machine learning: We use state-of-the-art monitoring and control technology as well as condition monitoring to improve plant performance and availability in the process and manufacturing industry.

4) Industrial communication: It is our vision to create an Industrial Internet of Things (IIoT) in manufacturing, making real-time information available on all levels of a distributed automation system in the required quality and allowing devices to be integrated on the basis of standardized PLUGandWORK principles. 5) Industrial Smart Grids: We deal with the challenge of energy management in manufacturing operations. To this end, our specialists make use of the principles of smart grids, including the integration with the smart grids of energy providers. We combine our expertise in energy management and suppliers’ energy data management with long-term experience in monitoring production plants on behalf of energy consumers. 6) Industrial human-machine interaction and assisting systems: Innovative interaction technologies open up large potentials even in factories. In control rooms, the staff focuses on operating and monitoring the specific part of a production or supply chain process of which they are in charge. By means of role-based gesture interaction, they will be able to cooperate in fulfilling interdisciplinary tasks in the future. This will accelerate the decision-making process, while the system can be used more intuitively. 7) Robot systems - Mobile platforms and manipulators: This area focuses on activities relating to the control of autono- mous and partly autonomous robots and vehicles, acting as individuals, in groups and in cooperation with human beings. 8) IT security for industrial production: Today’s production plants are highly interconnected. Embedded systems interact independently; planning systems from the cloud schedule production steps and machine utilization; plant operators monitor and control remotely; maintenance staff has global access to modify configurations. IT security in industrial production has to take into account specific basic conditions which are not as relevant in an office environ- ment, in the case of PC workstations or Internet servers. We are member of a variety of industrial consortia and organizations bringing forward the idea of IIoT and Industrie 4.0, among which are the Industrial Internet Consortium (IIC), working groups of the Platform Industrie 4.0, expert panel of the Standardization Council Industrie 4.0 (SCI4.0), OPC Foundation and AutomationML e.V. Our ambition is to realize smart production systems and components based upon open systems architectures and associated international standards such as RAMI4.0, OPC UA and AutomationML. Equipment / Laboratory Facilities / Software tools • Model factories at IOSB Karlsruhe and at the IOSB sub-institute Industrial Automation (INA) in Lemgo, both member of the Labs Network Industrie 4.0 (LNI4.0) • IT security lab for industrial production • IIC testbed “Smart Factory Web” • ProVis testbed • AutomationML™ test center • Test installation to demonstrate interoperability and adaptivity • Design and simulation tools for engineering and testing micro-electronic IPs in the field of real-time communication Network-based data loggers for process and system diagnosis • Autonomous robot platforms • ICT energy laboratory at the sub-institute of Advanced System Technology (IOSB-AST) References / product highlights • ProVis.Agent® integrated monitoring, control and reporting system for car body, paint and assembly shops of the Bremen and Woerth plants of Daimler AG • Integration platform in the press shop of the Bremen plant of Daimler AG • ProVis.Agent® monitoring and control system for Thyssen Krupp Steel AG, Duisburg • interoperability tools based on AutomationML and OPC UA • Open62541 - open source implementation of OPC UA • ProDaMi: suite containing data mining tools for decision support in manufacturing • Predictive maintenance based on machine learning for Bayer AG, Leverkusen • PROFINET single-chip solution for Phoenix Contact, Blomberg and Siemens AG, Nürnberg • Various projects relating to Industry 4.0, such as IIoT consulting, platform specification, MES-microservices specifications 3 1

1 ISuTest: INDUSTRIAL SECURITY TESTING A Modular Security Testing Framework for Industrial Automation and Control Systems (IACS) Industrial automation and control systems (IACS) play a key role in moder n production facilities. Not only do they add real-time functionality to the connected field devices, they are also increasingly being connected to local networks and the Inter net in order to facilitate use cases promoted by “Industry 4.0”. This makes IACS susceptible to cyber-attacks which exploit vulnerabilities, for example in order to interrupt the automation process. Security testing aims to discover these vulnerabilities before they can be exploited. We developed ISuTest, a modular security testing framework for IACS, to enable IACS manufacturers and integrators to perform security testing for their devices. Task description The objective of security testing is to reveal vulnerabilities. ISuTest applies the negative testing principle which monitors the system’s responses to unexpected inputs. Additionally, ISuTest acts as black-box testing system. In other words, ISuTest tests devices from an attacker’s point of view. Based on a comprehensive review of existing security testing approaches both for common office systems and IACS as well as IEC 62443 as the standard for network and system security in industrial communication networks and its corresponding EDSA (Embedded Device Security Assurance) certification program, we defined the following requirements for ISuTest: (I) (II) modes (Ethernet, digital, analog IO, etc.), and (c) modes of evaluations (network packets, (III) Vulnerability tests in ISuTest must (a) be defined in test descriptions as declaratively as possible, (b) allow for arbitrary combinations of protocols, input and output modes and evaluations, (c) evaluate outputs against a reference, (d) be executable using fully automated processes in a sequential order, and (e) be reproducible. ISuTest must be suitable for testing arbitrary IACS for vulnerabilities. ISuTest must be modular and flexibly extensible regarding (a) automation protocols and other network protocols (Profinet, EtherCAT, TCP, ICMP, etc.), (b) input and output signal behavior, etc.). Contact: Dr.-Ing. Christian Haas Phone +49 721-6091-605 christian.haas@iosb.fraunhofer.de Result description ISuTest is designed to be extendable for use with all kinds of automation protocols and dif- ferent connection technologies as well as to evaluate arbitrary outputs of the tested devices. In a basic test environment, compliant with the ISASecure EDSA certification program shown in Fig. 2, a Test Device (TD) is connected to a Device under Test (DUT). The TD feeds the DUT 3 2

2 3 with inputs and measures the outputs from the DUT. A test set defines the inputs and outputs that are expected for those particular inputs. To pass the test, the actual output needs to match this definition. When testing IACS, the input and outputs can be of different kinds, e.g. digital or analog signals, or communication via network protocols. Test cases in ISuTest are defined declaratively in test scripts. Modules can execute arbitrary operations at defined times of a test execution. Those operations may create DUT input, gather DUT output or control an external device. Modules, as well as evaluations, can be selected and configured in the test scripts. Evaluations encapsulate a specific algorithm that determines how the DUT’s output and the reference are used to determine the evaluation result. Possible evaluations range from Boolean comparators up to pattern-searching algo- rithms on packet captures or analog signals. The test scripts are executed by a scanner which interfaces the well-known Open Source Vulnerability Assessment System OpenVAS. Project description The ISuTest framework was evaluated within the Fraunhofer IOSB Security Laboratory for Industrial Control Systems. An experimental setup is shown in Fig. 3. It consists of the equip- ment required to conduct testing of a typical IACS, including a 24V power supply and network equipment. A remote controllable power switch is used to automatically reset the DUT during testing while a Programmable Logic Controller (PLC) provides access to the digital and analog I/O of the DUT. The framework software is hosted on a dedicated PC system. Using the setup, we performed various tests with different automation equipment, such as PLCs and bus couplers. The tests were performed automatically which made it possible to repeat the same test with reproducible results. Performing the tests, we identified several weaknesses. For example, a bus coupler crashed: when receiving a specifically-crafted Profinet network packet, it stopped the digital process output without sending an alarm. Even switching the power supply off and on could not reset the device back to normal operation. Summary The transition in modern industrial facilities towards the IIoT and the ongoing networking of industrial automation and control devices is creating strong demand for increased security. Testing and certification of these systems is necessary to improve the capabilities of manufac- turers, integrators and end users. ISuTest is a new and open source industrial security testing framework which fills this gap. Its design follows an extensible approach and can be used via OpenVAS which is already established in the traditional security testing domain. ISuTest was evaluated in an actual experimental setup and showed promising results enabling the detection of possible vulner- abilities in the tested IACS devices. 1 Typical IACS components which could be exploited by attackers. 2 Basic test setup consisting of a Testing Device (TD) and the Device under Test (DUT). 3 Experimental setup of ISuTest at IOSB Karlsruhe. Project execution Dipl.-Inform. Steffen Pfrang, David Meier M.Sc. Literature [1] Pfrang, S.; Meier, D.; Kautz, V.: Towards a Modular Security Testing Framework for Industrial Automati- on and Control Systems: ISuTest, (to be published) [2] ISA Security Compliance Institute (ISCI), “Embedded Device Security Assurance (EDSA) - version 2.0.0”, http://www.isasecure.org/ en-US/Certification/IEC-62443-ED- SA-Certification 3 3

1 IIC TESTBED SMART FACTORY WEB Creating a marketplace for industrial production The Smart Factory Web (SFW) is a collaboration between Fraunhofer IOSB and the Korea Electronics Technology Institute (KETI) in the area of Industrial Inter net of Things for smart factories. It consists of a web of cooperating factories in Germany and the Republic of Korea and is open for additional facilities, experiments and partners. SFW enables flexible adaptation of production capabilities and sharing of resources and assets to improve order fulfilment and create a marketplace for manufacturers. It addresses architectural and security issues in a connected web of factories. The Industrial Inter net Consortium® (IIC™) has approved the SFW as a new member of its family of testbeds to validate its Industrial Inter net Reference Architecture (IIRA) and technologies for the Industrial Inter net of Things. Task description The Smart Factory Web serves as a marketplace for suppliers and service vendors. It applies the IIRA 3-tier architectural pattern in two planes to connect factories and their assets. This intelligent network of smart factories makes it easy for manufacturers to adapt production capabilities and share resources and assets to improve order fulfilment. Result description The Smart Factory Web uses IOSB’s WebGenesis® platform to create an interactive and informative visualization of a factory network with asset registration and search. With smart searches, users can assess and compare capabilities of manufacturing sites and order products from the site most suitable for their requirements (Fig. 1). In addition, vendors can quickly respond to changing B2B customer needs. The use of the industrial standards OPC UA and AutomationML facilitates factory-to-factory interoperability enabling cross-site usage scenarios with secure Plug & Work functions and data analytics. It enables flexible assignment of production resources across factory locations so a single business can easily implement new business models. Factory resources are managed efficiently with a view of all factories by using mashup, simulation and data analytic services. The SFW reduces IT-system integration and installation costs and improves equipment utilization by faster engineering and ramp-up time of IT systems. Contact: Dr. Kym Watson Phone +49 721 6091-486 kym.watson@iosb.fraunhofer.de Information Management and Production Control www.iosb.fraunhofer.de/ILT 3 4

2 3 Project description The Smart Factory Web uses two planes based on the IIRA’s 3-tier model. In the upper plane, the SFW serves as a portal where assets and interactions across factories are described and visualized (Fig. 2). Users enter information about factories, capabilities and properties of assets in an intuitive, easy-to-configure user interface which visualizes the whole value chain. The lower plane is a Smart Factory with a Factory Digital Image for secure, performant communication with the SFW. Here, Fraunhofer ILT and Fraunhofer INA are contributing two model factories: Fraunhofer IOSB’s model factory Plug & Work in Karlsruhe and selected equipment at the SmartFactoryOWL in Lemgo. KETI’s model factories in Pangyo and Ansan, South Korea, are also an integral part of the SFW. They are linked to the German model fac- tories to achieve a cross-factory, cross-organization usage scenario. Factories and their equip- ment can be set up as assets and their capabilities and properties can be described (Fig. 3). This can be done either manually or in an automated way by importing an asset description in AutomationML. Secure Plug & Work techniques based on the standards AutomationML and OPC UA are applied to adapt factories on-the-fly by inserting new manufacturing assets into the factory production with a minimum of engineering effort. These standards are applied for information modeling and communication in both planes. The concept can be applied not only to industrial manufacturing scenarios, but also to other production chains, for instance in the food industry. Taking fair trade chocolate as an example, it takes just a few hours to describe the whole fair trade chocolate supply chain in SFW, from harvesting cocoa beans to sugar refinement, blending, moulding, packing, labeling and delivery (Fig. 1). The level of detail can be varied as required by the data com- munication across the supply chain. 1 Smart Factory Web visualizes the availability of manufactur- ing resources in an instant. 2 Factories and assets are integrated in stages forming a global marketplace for manufacturing services. 3 Capabilities and properties of a packaging machine (asset) of a factory are displayed in a tab-view . Customer Korea Electronics Technology Institute (KETI) Project execution Dr.-Ing. Michael Baumann, Kevin Becker, Dipl.-Ing. Robert Henßen, Dipl.-Inform. Kavyashree Jamboti, Dipl. Biol. Katja Kornetzky, Dr.-Ing. Siegbert Kunz, Dr.-Ing. Miriam Schleipen, Dipl.-Inform. Boris Schnebel, Dr. rer. pol. Ljiljana Stojanovic, Dipl.-Ing. Michael Theis, Dr.-Ing. Thomas Usländer, Dr. Kym Watson Literature [1] Jung, J.; Song, B.; Watson, K.; Usländer, T.: Design of Smart Factory Web Services Based on the Industrial Internet of Things. Proceedings of the 50th Hawaii In- ternational Conference on System Sciences, 2017, pages 5941-5946 3 5

1 SmartBox: ADAPTIVE MONITORING ON THE FIELD LEVEL Flexible system for data-driven anomaly detection Automated production processes offer a wide range of options for networking and control. At the same time, the opening of local networks and increasing complexity of manufacturing processes demands a higher level of technical security and preventive measures to protect them against disruptions from both inside and outside the process. After all, reliability and integrity are key arguments in making Industry 4.0 solutions attractive to manufacturing companies. The “SmartBox” developed by Fraunhofer IOSB-INA in Lemgo offers a universally applicable solution which identifies anomalies in processes using PROFINET data. Task description More networking of machinery and equipment and the digitization of production processes are opening a host of new opportunities for enhancing efficiency, transparency, control and product variety. At the same time, the early detection of faults and errors is one of the most important tasks in any automated production system. It plays a vital role in reducing costs and the risks of component failures or even production standstills. Calculating failure probabilities should ideally enable operators to prevent faults before they occur [2]. However, manually configuring an error detection system is often complicated and time- consuming as it requires changes to be made in the control program and precise tailoring to the application. This applies particularly if the error detection system is implemented in the programmable logic controller (PLC). In this case, it is usually necessary to reprogram the system – an even more complex task for which a profound knowledge of the entire process from the perspective of the automation engineer and the programmer is essential. Moreover, the data used in error detection on the control level are often filtered or modified. The chal- lenge is to develop a simple, highly self-sufficient system which can be used in a variety of processes and reliably predicts faults based on easily accessible data [3]. Result description The solution developed by Fraunhofer IOSB-INA is a self-configuring unit which is passively connected to the process and its controls Fig. 1. It learns the behavior of the process auto- matically using PROFINET data. It detects errors by comparism of model and observed data abstracted from the process and its controls. It can be integrated into any industrial Ethernet system via a switch with mirror port or a network tap. This was tested for a variety of produc- tion plants – including a reconfigurable production system used to process bulk goods and a flexible manufacturing system in the SmartFactoryOWL. Fig. 2 and 3 shows the integration of the SmartBox into a into a demonstrator. Here, the SmartBox is connected via Ethernet to the Contact: Dr.-Ing. Stefan Windmann Phone +49 5624 94290-51 stefan.windmann@ iosb-ina.fraunhofer.de Machine Intelligence www.iosb-ina.fraunhofer.de 3 6

Process Field Device Switch PLC Mirror port 2 SmartBox Control Switch with port mirror Field Instrument Prozess SmartBox 3 port mirror of a switch between the PLC and field instruments. The extraction of process data from Industrial Ethernet Frames, without communicating via the control level, is the defining feature of the SmartBox’s method of operation. It requires no changes to the projected auto- mation system. So far, the system has been tested for PROFINET networks. The next phase of development will implement an extension of the system and enable it to operate with other industrial Ethernet networks, such as EtherCAT. 1 SmartBox. 2 Overview of the prototype design. 3 The error analysis uses mir- rored sensor data supplied via the switch directly from the field level. Project description The SmartBox can operate in three simple modes: 1) Self-configuration 2) Model learning 3) Error detection In the self-configuration phase (1), the SmartBox analyzes the initialization frame of the Ethernet system and GSDML files to initialize the information required for model learning and error detection. These files must be saved one time. During model learning (2) and error detection (3), the SmartBox receives and decodes the mirrored process data. In the learning phase (2), it uses the data to generate process models automatically. The data received during the error detection phase (3) are continuously compared with the process model. Deviations are recorded and assessed as possible errors. If these deviations exceed specified limit values, the SmartBox can issue a warning that indications of an error have been detected. A number of different algorithms for both model learning and error detection have already been implemented in the SmartBox. The simple technical implementation for recording PROFINET data is not the only remarkable aspect of the SmartBox – the handling and preparation of the extracted process data using machine learning of the process behavior is also a key feature. This uses automatically generated process models to predict the condition of machines and plants. An explanation is provided using the example of “ComPACT” (Computation of Parallel Automata by Clustering Tech- niques) [4] – one of the learning algorithms used in the SmartBox – which is particularly suited to learning discrete process models. Learning procedures for continuous and hybrid processes are also implemented in the SmartBox. The ComPACT algorithm learns from the input and output signals recorded from parallel automated machines. The SmartBox offers a solution for identifying potential anomalies and faults automatically. It requires no integration into the equipment controls and uses a relatively low level of computing power. The process behavior is modeled independently of the specific process and components enabling the operator to identify isolated faults in individual areas or complete processes in real-time. The versatility of this solution in a wide range of production processes of any size, sector or production environment makes it highly attractive. References [1] Windmann, S.; Niggemann, O.; Trsek, H.: “Konzepte zur Erhöhung der IT Sicherheit in industriellen Automatisierungssystemen”, in: Automation 2016, VDI Wissens- forum Baden-Baden, 2016 [2] Windmann, S.; Eickmeyer, J.; Niggemann, O.: “Fehler in Prozes- sen zuverlässig erkennen”, in: atp edition, [S.l.], v. 58, n. 04, p. 22-29, apr. 2016. ISSN 2364-3137 [3] Windmann, S.; Niggemann, O.: “A Self-Configurable Fault Detection System for Industrial Ethernet Net- works”, in: at – Automatisierungs- technik, 2017 [4] Windmann, S.;Lang, D.; Niggemann, O.: “Learning Parallel Automata of PLCs”, in: 22nd IEEE International Conference on Emerg- ing Technologies And Factory Automation, 2017 3 7

1 INTELLIGENT ASSEMBLY ASSISTANCE Interactive networking of man and machine In fast-moving markets, flexible, customized production processes are in greater demand than ever before. This project aims to develop and evaluate the diverse options for accelerating assembly and initial training processes for employees in different areas of the production environment. It focuses on digitally mapping the assembly process to provide targeted instructions for employees. Benefits are expected to include lower error rates, improved ergonomics and a reduction in the cognitive workloads through the provision of active assistance. During the project, the team developed and evaluated two research demonstrators: IPAS, a fixed-position assembly workstation with visual assistance, and M²-Assist, a mobile version of the assembly assistance system. Task description The advent of the Industry 4.0 age has been accompanied by an increase in complexity – especially in the daily tasks of employees working closely with production equipment. Assis- tance systems can counteract this perceived growth in complexity by offering individual support for employees, e.g. by providing task-related information directly in the operator’s workplace environment [1][4]. This offers many advantages, such as low error rates, quicker initial training, higher quality processes and production, better occupational health and safety and a general improvement in workplace ergonomics. A few assistance systems based on augmented reality (AR) technologies are already being used successfully by major international companies. Growth rate forecasts for AR-based assistance systems are in the region of 70 % or more annually. This implies that they will have been widely adopted by industry within the next 5 to 10 years. However, systems of this type are rarely used by small and medium-sized enterprises today. This is mostly due to the disadvantages of currently available systems, e.g. high acquisition costs and lack of flexibility. The following project aims to refine and evaluate assistance systems and realize their potential for additional applications in a wide range of areas. Result description The project investigated the application potential of AR technologies in an industrial context using a number of demonstrators. The efficient coordination of automated and human assembly processes was studied using the “IPAS” (Intelligent Personalized Assistance System) demonstrator in the SmartFactoryOWL test environment. As well as providing visualized information tailored to specific situations and needs, the system can also be converted to Contact: Prof. Dr. Dr. habil. Carsten Röcker Phone +49 5261 70254-88 carsten.roecker@ iosb-ina.fraunhofer.de Digital Infrastructure www.iosb-ina.fraunhofer.de 3 8

2 3 new products flexibly and without the need for additional programming. For production processes distributed across several sites, the mobile demonstrator M²-Assist uses a networked assistance system which is able to connect assembly stations operating anywhere in the world. This creates a seamless flow of data and synergies which allow the system to be used in a broad range of applications. Further, the standards permit collaboration and communication between two workstations. An augmented reality video conferencing mode permits two tech- nicians in separate locations to communicate and help each other in the assembly process from a variety of camera angles. An innovative interactive mode enables them to highlight specific active areas in the workspace they are observing. Project description Using the example of a projection-based assembly assistance system, Fraunhofer IOSB-INA is investigating how assembly technicians can be integrated into the production process according to their individual capabilities and at what points they can be offered targeted support using existing technologies. Winning the acceptance of users is an important priority and one of the key factors by which the success of the practical implementation will be judged [3]. By linking assembly tasks with information from the virtual world, the employee can be guided through each step of the assembly process – thus increasing the importance of human beings in Industry 4.0. As well as an integrated multi-touch screen and pick-to-light modules, users also have access to visual aids in the form of text, graphics or videos directly at the assembly station using projections [1][5]. Gesture recognition and the depth camera system allow the assistance system to be controlled safely and intuitively by touch recognition (“Smart Surface”) even in industrial environments [2]. Further interfaces to position recognition and screw data recognition systems are available for long-term quality assurance. These are effective in identifying and controlling tool processes (e.g. position of a screwdriver). The assistance system can record all the production parameters (e.g. components used, assembly stages, duration of assembly process, etc.) for end-to-end product traceability and save this data directly on the manufactured part using RFIDs. During the development process, the team focused on producing a flexible, modular design which would permit individual components of the assistance system to be integrated or retrofitted into existing production systems as required. To emphasize the oper- ating principle of the projection-based assembly station, the team also developed a mobile demonstrator which uses the core technologies of the fixed location workstation. 1 IPAS – The intelligent, personalized assistance system. 2 Mobile demonstrator M²-Assist. 3 AR-based assistance using remote support across a number of locations. Literature [1] Röcker, C.; Robert, S.: Projekti- onsbasierte Montageunterstützung mit visueller Fortschrittserkennung. In: visIT – Industrie 4.0, Fraunhofer IOSB, Karlsruhe, pp. 12-13, 2016 [2] Büttner, S.; Sand, O.; Röcker, C.: Exploring Design Opportunities for Intelligent Worker Assistance: A new Approach Using Projection- Based AR and a Novel Hand- Tracking Algorithm. In: A. Braun, R. Wichert, A. Maña (Eds.): Ambient Intelligence. Proceedings of the European Conference on Ambient Intelligence and the Internet of Things (AmI’17), LNCS 10217. Springer, Heidelberg, Germany, pp. 33-45, 2017 [3] Fellmann, M.; Robert, S.; Büttner, S.; Mucha, H.; Röcker, C.: Towards a Framework for Assis- tance Systems to Support Work Processes in Smart Factories. In: A. Holzinger P. Kieseberg, A M. Tjoa, E. Weippl (Eds.): Machine Learning and Knowledge Extraction. Procee- dings of the International Cross Domain Conference for Machine Learning & Knowledge Extraction (CD-MAKE’17), LNCS 10410. Springer, Heidelberg, Germany, pp. 59-68, 2017 [4] Sand, O.; Büttner, S.; Paelke, V.; Röcker, C.: (2016). smARt.Assembly – Projection-Based Augmented Reality for Supporting Assembly Workers. In: Lackey S., Shumaker R. (Eds.): Virtual, Augmented and Mixed Reality, Lecture Notes in Computer Science, Vol. 9740, Springer International Publishing, Switzerland, pp. 643-652, 2016 [5] Paelke, V.; Röcker, C.; Koch, N.; Flatt, H.; Büttner, S.: User interfaces for cyber-physical systems. at- Automatisierungstechnik, 63(10), 833-843, 2015 3 9

1 KARLSRUHE CENTER FOR MOBILITY SYSTEMS Resilient co-operative driving in mixed traffic The Karlsruhe Center for Mobility Systems (Fraunhofer Leistungszentrum Profilregion Mobilitätssysteme) brings together Karlsruhe’s five Fraunhofer institutes and three universities to offer companies comprehen- sive mobility-related research from a single source. To demonstrate synergies, the participants in the Center’s subproject “Connected Mobility (CM)” jointly elaborated a scenario that integrates all of their areas of research. The core of this scenario is a cyber-attack on car-to-car communication of autonomously driving vehicles. A first realization of the scenario was implemented using the OCTANE simulation platform developed by Fraunhofer IOSB and has been presented to a wide audience at several events including the 2017 Hannover Trade Fair. To achieve resilience to the attack, a visual light communication protocol via car headlights was implemented. Task description Cooperative driving of autonomous vehicles is a multidisciplinary challenge involving environ- ment sensing, maneuver planning, highly performant and reliable electric / electronic architec- tures, car2car communication based on secure protocols and cryptography, and negotiation techniques to define cooperative groups as well as joint driving maneuvers. One major aspect is the security of the communication. Modern vehicles incorporate all of the necessary technolo- gies and protocols available to prevent intrusion by a hacker. The task of the Karlsruhe Center for Mobility Systems’ subproject “Connected Mobility (CM)” was to highlight cyber risks that remain in the overall system even if the individual cars are perfectly secured. The main guiding questions of CM participants were: Is it sufficient, if vehicles are perfectly secured? Or is there a weak spot in the system that makes a massive cyber-attack possible? And, if so, do possible mitigation measures exist which are capable of preventing the risk? The challenge was to define a scenario that is plausible in all of the aforementioned aspects of cooperative driving. Contact: Dr. Dieter Willersinn Phone +49 721 6091-387 dieter.willersinn@iosb.fraunhofer.de Systems for Measurement, Control and Diagnosis www.iosb.fraunhofer.de/MRD Result description As a first result, the project identified an attack route capable of causing serious accidents without the need to manipulate an autonomous car: it appeared to be sufficient for a hacker to install a virus on a car driver’s private smartphone. This scenario is relevant to the near future when fully automated cars will share public space with cars that are driven by human drivers. The smartphone virus establishes formally correct car-to-car connections to fully automated cars, incorrectly identifies the smartphone owner’s 4 0

2 car as being fully automated, and negotiates potential cooperative evasion maneuvers. When a particular critical evasion maneuver is requested, it confirms and causes a severe accident risk since the smartphone owner is completely unsuspecting and does not react accordingly. Experiments carried out with the IOSB simulation platform OCTANE, confirm the risk and make it possible to evaluate both the potential damage and the effectiveness of countermeasures. 1 Cooperative evasion maneuver. 2 Confirmation protocol using visual light communication via LED headlights. One possible countermeasure is to request a confirmation of the evasion maneuver via an inde- pendent communication channel. In CM, such a confirmation measure has been implemented by means of visual light communication using LED headlights. This dramatically increases the effort required by a potential attacker: he must not only infiltrate a smartphone, but also the highly secured IT infrastructure of a car. Project description At the Karlsruhe Center for Mobility Systems (Fraunhofer Leistungszentrum Profilregion Mobilitätssysteme), the Fraunhofer Institutes ICT, IOSB, ISI und IWM as well as the Fraunhofer Project Group NAS are investigating the mobility of the future in partnership with the Karlsruhe Institute of Technology (KIT), the Karlsruhe University of Applied Science (HsKA) and the Karlsruhe Research Center for Information Technology (FZI). Seven subprojects are dedicated to the central challenges of efficient, intelligent and integrated mobility in all of its aspects and link with important players from science, applied research and industry. The Center’s mission is to leverage synergies of existing competences for the develop- ment of future-proof mobility solutions and establish the necessary partnerships to strengthen mobility innovation in and from Baden Württemberg. Besides Connected Mobility, six other subprojects focus on various facets of mobility. One subproject analyzes changing mobility demands due to demographic change and increasing urbanization and derives new mobility solutions and technical solutions. Two other subprojects address future urban infrastructure and connected mobility enabled by new ICT platforms. Automated and autonomous mobility is the topic of another subproject which is developing an autonomous shuttle. Research is also being conducted in the field of hybrid and fully electric as well as combustion engines to further improve efficiency and reduce CO2 emissions. The seventh project addresses integrated lightweight construction using intelligent combinations of materials. Project Partners The participants to the Karlsruhe Center for Mobility Systems' subproject “Connected Mobility (CM)” include four institutes of the Karlsruhe Institute of Technology (KIT), the Karlsruhe Research Center for Information Technology (FZI) and Fraunhofer IOSB which is acting as a coordinator. Project execution Fraunhofer IOSB: Dipl.-Ing. Miriam Ruf, Prof. Dr.-Ing. habil. Jürgen Beyerer, Dr.-Ing. Christian Frese, Max Filsinger M. Sc., Dipl.-Inform. Masoud Roschani, Dr. techn. Dieter Willersinn, Jens Ziehn M. Sc., KIT-MRT: Ole Salscheider M. Sc., KIT ITIV: Dipl.-Ing. Falco Bapp, Prof. Dr.-Ing. Dr. h. c. Jürgen Becker, Andreas Lauber M. Sc., KIT-KASTEL: Prof. Dr. Jörn Müller-Quade, Dipl.-Inform. Bernhard Löwe, Dr.-Ing. Mario Pauli, Dipl.-Inform. Jens Doll, Dipl.-Math. oec. Christian Hubschneider, Uni Hannover: Prof. Dr.-Ing. Bodo Rosenhahn Literature [1] Bapp, F.; Becker, J.; Beyerer, J.; Doll, J.; Filsinger, M.; Frese, Ch.; Hubschneider, Ch.; Lauber, A.; Müller-Quade, J.; Pauli, M.; Roschani, M.; Salscheider, O.; Rosenhahn, B.; Ruf, M.; Willersinn, D.; Ziehn, J.R.: A Non-- Invasive Cyberrisk in Cooperative Driving. In: 8. Tagung Fahrerassis- tenz: Einführung hochautomati- siertes Fahren. 22.-23. November 2017, München 4 1

PRIVACY-AWARE ASSISTANCE SYSTEMS Privacy by design and identity management infrastructure Interactive assistance systems are finding their way into daily life. Smart homes increase our comfort by controlling indoor climate, lighting or entertainment electronics according to our preferences. Future work- places will interactively guide workers through complex manufacturing processes and assist surgeons during surgery. Aiming to be situation-aware and unobtrusive requires such assistance systems to monitor users, objects, and environmental conditions using a multitude of sensors. Personal data is collected and processed on a large scale, which raises privacy concerns and risks of abuse. This applies for workspaces, but also for smart home solutions, which often rely on cloud services for data analysis. Thus, interactive assistance systems have to be designed with caution, keeping in mind the paradigm of Privacy by Design (PbD). Task description Like interactive assistance systems, data protection is user-centric. It demands that users maintain sovereignty over their personal data, i.e. users must be able to determine which data is collected and used for which purposes by a digital assistance system. Assistance systems must also be transparent about whether and how long user data is stored, and about optional personal data, i.e. data that is not mandatory for the system to provide its service but may, for example, increase its awareness of a situation. Consider a system that guides a worker through a manufacturing process. The system has to capture the worker’s activities in order to provide appropriate instructions for the detected workflow phase. It may be able to offer even better support if it is allowed to track parameters indicating the worker’s stress level. However, the worker is free to reject this extended data processing option or only agree to it for a short trial period. While raw sensor data typically does not have to be stored (live data), derived informa- tion must, to some extent, persist in order to configure the system for a given user (profile data). Profile data may include information such as “user X is experienced with manufacturing steps a, b, and e”, “user X is left-handed”, or “user X is stressed once his heart rate exceeds 110 bpm”. Profile data may also be directly provided by the user himself (e.g. “left-handed”), and the risk of abuse varies from non-existent to extremely high if it could be used for illegiti- mate performance monitoring or drawing conclusions regarding the user’s state of health. Contact: Dr.-Ing. Pascal Birnstill Phone +49 721 6091-612 pascal.birnstill@iosb.fraunhofer.de Interactive Analysis and Diagnosis www.iosb.fraunhofer.de/IAD 4 2

User Device Assistance System Identity Provider- Service 3. Authorization Token 1. Required Data and Purposes 2. Authorization, Usage Policy 1 Hex Torx 4. Profile 1 Privacy Arrangements between user and assistance system. Result description The design of a privacy-aware assistance system must therefore provide an interface for making personal data collection and usage transparent and for defining usage arrangements according to users’ preferences. In other words, this interface needs to be able to commu- nicate with an infrastructure for maintaining and storing users’ profile data including usage policies for the personal attributes contained in a profile. The authors propose the following infrastructure (see Fig. 1). A smartphone app receives data requests from assistance systems. Based on this information, the user can create an abstract profile (list of attributes) and a corresponding usage policy for the given system. The profile data, i.e. the particular attribute values, are stored in an externally operated identity service, so that the user can authorize the assistance system to obtain his profile from there. An assistance system, on the other hand, must be equipped with trustworthy mechanisms for enforcing the usage policies of profiles (e.g. usage control technology). The correctness of these mechanisms must be verified either by a certification process or by means of software verification methods. Finally, the system’s integrity must be verifiable at any time so the user can make sure that an assistance system has not been manipulated since it was certified/ formally verified. This can achieved by means of remote attestation protocols based on unforgeable hardware trust anchors such as Trusted Platform Modules (TPMs). Project description The project “Identities in Smart Environments” run by the Competence Center for Applied Security Technology (KASTEL) and funded by the Federal Ministry of Education and Research started in May 2017 and addresses the challenges described above. Its first task is concerned with deriving privacy requirements from (employee) data protection law in order to produce templates of usage policies which users should be able to arrange with assistance systems and which assistance systems must be able to enforce. Following this, the second task will design a generic architecture for interactive assistance systems with integrated usage control mechanisms for enforcing the identified usage policies. The third task is concerned with the development of an infrastructure for identity management, i.e. a user interface for maintain- ing profiles and appropriate usage policies, an authorization service for assistance systems to demand access to a given user’s profile and a secure storage service for profiles. Literature [1] Krempel et al., Working and living in interactive environments - requirements for security and pri- vacy, Ambacher, Oliver (Ed.) et al.: Security Research Conference. 11th Future Security: Berlin, Sep- tember 13-14, 2016. Proceedings. Stuttgart: Fraunhofer Verlag, 2016, pp. 315-322 4 3

B U S I N E S S U N I T B U S I N E S S U N I T ENERGY, WATER AND ENVIRONMENT Spokesperson Prof. Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 Deputy Spokesperson Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 Mission and vision The nexus of sustainable and affordable energy, secure access to clean drinking water and effective environmental protection must be better understood and managed through the provision of tools, models and methodologies to exchange and process data. This is fundamental for the development of solutions meeting the needs of future markets. Fraunhofer IOSB offers integrated ICT systems, consulting services, and development of prototypes to industrial clients and public authorities that approach the problem from a holistic point of view. They cover the whole spectrum from sensor systems, systems modeling, and systems analysis to knowledge-based process optimization 4 4 with a wide range of methods and sophisticated algorithms. An example for these applications is the energy market solution EMS-EDM PROPHET® that supports utility companies and system operators with varied and complex tasks in a liberalized market environment. In the fields of water management as well as environmental information and early-warning systems, our business unit offers customized ICT applications for the private and public sectors. The objective is to provide integrated solutions that are flexible and can also adapt to individual constraints, such as those of service oriented architectures (SOA) and standard interfaces of the “Internet of Things and Services”. Beside the close collaboration with industry, the business unit sees itself as a technology driver for future energy and water management solutions. Examples are enhanced power grid solutions (BMWi founded research pro- jects VEREDELE, REGEES and DynaGrid), the IoT based energy management on building and quarter level (BMBF founded projects EBITA and EffMon). Furthermore, a new Learning Lab IT Security for critical infrastructures was established at the sites Ilmenau and Görlitz in 2017. Core competencies and markets The business unit has its core competencies in the areas of decision-making-strategies and optimal control solutions for complex technical and non technical processes. Furthermore, service oriented software applications (SOA), semantic technolo- gies and IoT-based frameworks as well as integrated informa- tion and communication systems are the scientific basis for various applications. The target groups for these applications range from utility companies through communal water suppliers to governmental institutions. The research and development activities are focused on the global trend of digitalization. In the area of public contract research, we are excellently positioned at the state, federal and European level. The market of innovative environmental information systems is served by the product suite WaterFrame®, which is installed for governmental use. Water- Frame® is extended according to customer needs to support standards of the Open Geo-spatial Consortium (OGC) compliant with the requirements of the Group on Earth Observations (GEO)

References • ABB AG • AHK GmbH, Freiburg • IWHR • Bonneville Power Administration (BPA) • China Institute of Water Resources and Hydropower Research (IWHR) • Disy Informationssysteme GmbH, Karlsruhe • DONG Energy Germany • Kraken Sonar Inc. • Ministries of Environment and Federal State Agencies of Baden-Wuerttemberg (LUBW) / Rhineland-Palatinate / Thuringia (TLUG) / Bavaria (LfU) • natGAS AG • Nanjing Hydraulic Research Institute • Spacebel, Belgium • Stadtwerke Bielefeld GmbH • Stadtwerke Ingolstadt GmbH • SWE Energy GmbH & SWE grid GmbH • TenneT TSO GmbH • The German Federal Institute of Hydrology (1)BfG • Wasserversorgung Zürich 1 The topics of the Business Unit Energy, Water and Environment. 1 and Infrastructure for Spatial Information in the European Community (INSPIRE). It is complemented with WebGenesis® for knowledge- and web-based information systems. The business unit’s portfolio is complemented by its know-how in the field of maritime system technology, which is specialized in the guidance of underwater vehicles for automated inspection of underwater infrastructures and for water quality monitoring. In 2017, Fraunhofer IOSB signed an exclusive licensing agreement for it's DEDAVE underwater robotics technology with Canadian based company Kraken Sonar Inc. Laboratory and test facilities ICT Energy Lab: energy and energy data management, virtual power plants, operational management of island and area networks, "Learning Lab IT Security for critical infrastructures" Intelligent energy systems research platform: micro grids, operational management strategies, storage management, automated metering, intelligent distribution networks, electric mobility Maritime systems research platform: 250 m³ water volume, lorry access capability, energy and data interface, rail system for object placement, pressure testing system for full ocean depth (1200 bar / 12.000 m) Smart City / Smart Building living lab: Internet of Things (IoT) technology, wireless sensor / actuator networks, smart control algorithms, data analytics Environmental sensor netwerk INSENSUM: based upon OGC Sensor Web Enablement standards Product highlights • EMS-EDM PROPHET® - energy and energy data management • Optimized operation control - Electric vehicle fleets: sMobility Commerical, EBUS - Energy Storage: ADELE-ING, SmartRegion Pellworm - Hydroelectric power stations (20 GW): HyPROM (USA) • HydroDyn - grid simulation solution for water and gas • WebGenesis® / WaterFrame® - environmental information system governmental agencies • Thematic information system for the Integrated Rhine Program 4 5

REGEES – RENEWABLE ENERGY SYSTEM WITH OPTIMIZED GRID INTEGRATION OF RENEWABLE POWER GENERATION Challenge The German government’s ambitious aim of pushing renewable power generation up to 50 percent of the overall power generation by 2030 (2050: 80 percent) is a major challenge for grid operators. With a gross power generation of around 190 TWh in 2016, Germany already produces every third kilowatt hour from wind, solar, biomass and hydropower. However, in 2016, the industry incurred costs of EUR 927 million just for redispatch actions and the shutdown of renewable energy generating capacity due to heavily loaded distribution and transmission power grids. Redispatches are unscheduled interventions by transmission system operators into conventional power plants to avoid grid congestion. In just one year, redis- patch activities totaled up to 8116 hours. This implies that Germany’s energy transition to renewable power is entering a new phase of system integration. There is a growing need to upgrade and expand power grids as well as to create greater flexibility in power generation and consumption. Solution The research project REGEES (optimized operation control strategies for a reliable power supply system enabling complete integration of renewable power generation by 2030) under the leadership of the Fraunhofer IOSB-AST is seeking solutions. It is attempting to identify the optimum methods for integrating a high proportion of renewable energy into the power sup- ply system. This will require development of coordinated controls for DSO and TSO networks as well as coordinated management of markets and grids. REGEES has a number of key aspects. The project must define the requirements for the standby generation system and produce a catalog of the necessary changes in the regulatory framework for reaching 100 percent integration of RES (at 50 percent of the gross power generation in 2030). It must create optimization and simulation models for the “market grid operation” taking into account market roles and responsibilities. In addition, it must produce a catalog for the temporal provision and distribution of essential information between market and grid players in order to implement the “market grid operation”. Contact: Advanced System Technology (AST) Branch of Fraunhofer IOSB Dipl.-Ing. Stefan Klaiber Phone +49 3677 461-105 stefan.klaiber@iosb-ast.fraunhofer.de Energy www.iosb.fraunhofer.de/?14593 4 6

Furthermore, the REGEES project has four main overall objectives: first, to tap the flexibility potential of power plants for control operation processes; second, to develop innovative grid operation strategies by integrating all grid levels (horizontal-vertical power flow optimization including a possible future overlay grid); third, to utilize the grid as a whole taking account of all available opportunities for storage, control and improved flexibility; and last but not least to enhance the contribution of renewable energy in providing ancillary services for grid operators. Project partners: Project execution Prof. Dr.-Ing. Peter Bretschneider Dipl.-Ing. Stefan Klaiber Steffi Naumann M. Sc. Literature [1] Zimmermann, T.; Klaiber, S.; Bretschneider, P.: "A Market System Operator as a new role to balance the distribution grid and to coordi- nate market and grid operations", IEEE International Energy Confe- rence (EnergyCon), Leuven, Belgium, April 4-8, 2016 [2] Zimmermann, T.; Klaiber, S.; Naumann, S.; Bretschneider, P.: „An Optimization Problem for Acquisition of a Balance Responsible Party in an Extended Scheduling Sys- tem”, International Conference on the European Energy Market (EEM), Dresden, 2017 [3] Klaiber, S.; Naumann, S.; Warweg, O.; Bretschneider, P.: „A New Operation Management Approach to Coordinate Market and Grid Operations”, International ETG Congress, Bonn, 2017 4 7

1 MOSIOP – MODEL-BASED SIMULATION AND OPTIMIZATION OF UV LED-BASED DISINFECTION SYSTEMS Sponsored by: BMBF Background Water is vital for human survival yet more than 660 million people worldwide do not yet have access to potable water. This, in turn, increases the spread of diseases and epidemics. Disinfection of drinking water and the provision of potable water for people everywhere are therefore key components of the UN’s Millennium Development Goals. Due to their relatively high cost, UVC-LEDs are not yet economically viable for these applica- tions so traditional lamps are currently preferred. Furthermore, there are a number of open questions regarding the use of LEDs in the disinfec- tion of drinking water which this sub-project aims to clarify. However, LEDs also have specific characteristics which offer the potential to resolve fundamental difficulties relating to current technologies. An LED does not need a warm-up phase so its power is available instantly. This offers the possibility of intermittent operation. Furthermore, the freedom to arrange LEDs in various configurations and combine different emission wavelengths enables designers to adapt their systems to different mechanisms of action. This opens up a variety of possibilities specifically in the area of reactor design. Thanks to the increasing efficiency of LEDs, smaller reactors for disinfection will become viable in the medium- to long-term. Moreover, their low power consumption makes them suitable for use with mobile energy sources dramatically increasing the number and scope of potential applications. Contact: Advanced System Technology (AST) Branch of Fraunhofer IOSB Dipl.-Ing. Thomas Westerhoff Phone +49 3677 461-107 thomas.westerhoff@ iosb-ast.fraunhofer.de Water and Mobile Systems www.iosb.fraunhofer.de/?14994 4 8

2 3 1 Circuit board of the cascad- able UV LED module. 2 Possible linear arrangement of the UV LED module. 3 Possible cylindrical arrange- ment of the UV LED module. Target Initially, the main target is the development of a cascadable UVC-LED disinfection module. Project partners • Advanced System Technology (AST) Branch of Fraunhofer IOSB • PURION GmbH • Xylem Water Services GmbH • DVGW - Technologiezentrum Wasser Project execution Dr.-Ing. Buren Scharaw Dipl.-Ing. Thomas Westerhoff Dipl.-Ing. Steffen Dietze The problem of ensuring adequate supplies of drinking water globally means the module will have to be safe and simple enough for anyone to use anywhere in the affected countries. Basic research will be conducted to close the knowledge gaps which currently exist in the field of using UV-LEDs efficiently for water disinfection. The knowledge gained will directly contribute to the development of the UV-LED module and enable it to be deployed at the POU (point of use) as well as in large-scale plants. Realization In the first phase, the Advanced System Technology (AST) Branch of Fraunhofer IOSB will investigate the technical aspects of replacing mercury vapor discharge lamps with LEDs and the corresponding regulations. It will also test different LED arrangements and identify the optimum configuration based on the observed light emission pattern. Subsequently, the project partners will develop a cooling concept using simulation and experimental techniques with the aim of slowing the ageing process of the LEDs as far as possible. The development of a pressure and UV-resistant transparent case and a water-proofed module plug connection are further important aims of the project. The research will conclude with the elaboration of a functional model of the module and the module board. 4 9

1 HOW TO ACCESS ENVIRONMENTAL SENSOR DATA IN A UNIFORM WAY The potential of the new OGC Standard SensorThings API A thermostat measures temperature, a smart meter the power consumption – all things will be smarter and contain sensors that monitor the world around us. This leads us to the question: how can we retrieve all this data? Almost every IoT platform has its own interface and all of them work differently. For the management of sensor data, a standard has already been specified by the Open Geospatial Consortium (OGC). The OGC is a non-profit organization founded in 1994 with the aim of defining open standards for the processing of spatial data. This standard has now been in existence for 10 years: the Sensor Observation Service (SOS). Task description However, SOS does not really fit into the modern world of the Internet of Things. It is based on heavyweight SOAP and XML, browsing through large data sets is not possible and deleting observations is not supported at all. It is therefore time for something new which is also suitable for devices with limited resources. The OGC has now developed such a standard for managing and querying sensor data: the SensorThings API [1]. The SensorThings API is designed specifically for web developers: it follows the REST principles, data is encoded in JSON and URLs are based on the OASIS OData URL conventions. As a result, all basic functions, such as the creation of new sensors and sensor values, are very simple but complex queries are supported as well. The SensorThings API is complemented by additional extensions. These include the MQTT extension which allows notifications to be generated as soon as a sensor provides new data and the batch processing extension which allows you to send several changes to the server at once. Like all OGC standards, the SensorThings API is free of charge and open. That is, everyone can see it and participate in the design. Result description Through its openness and simplicity, the SensorThings API offers everything necessary to become the new standard for querying and managing sensor data on the Internet of Things. However, until now there was no open implementation of the API. Contact: Dr. Jürgen Moßgraber Phone +49 721-6091-562 juergen.mossgraber@ iosb.fraunhofer.de Information Management and Production Control www.iosb.fraunhofer.de/ILT 5 0

2 1 OGC Compliance Certificate for the Fraunhofer SensorThings- Server. 2 OGC Dashboard showing live data. To overcome this problem, Fraunhofer IOSB implemented the first standard-compliant, open-source server called the "SensorThingsServer". The software is fully based on Open Source packages and freely accessible on GitHub [2]. For visualization of the sensor data, the IOSB knowledge management system WebGenesis supports dashboard functionality which can display several types of widgets (e.g. line graphs, maps). Project execution Dr. Hylke van der Schaaf, Michael Jacoby, M. Sc., Dipl.-Inform. Reinhard Herzog Project description At Fraunhofer IOSB, we use the SensorThingsServer to collect data about our building: temperature, energy consumption, water consumption, etc. Currently, about 6.8 million observations per month flow into the system. These are then combined with other operating data. The data are evaluated using a series of Python scripts, Java programs and a LabView evaluation which uses the different selection and filter functions of the SensorThingsServer. Furthermore, a real-time data visualization is used for status displays of different building data. Designing a new standard which is perfect from the outset is impossible. It is only when the standard is implemented and used independently by different groups that you can find out which details are not quite clear or where improvements are still necessary. For this reason, there is a SensorThings API GitHub project where developers and users can exchange ideas and make suggestions for improvement [3]. Part 2 of the SensorThings API, which is still under construction, will deal with the tasking of actuators. Alongside sensors, these are the second cornerstone of the Internet of Things. They allow the user not only to read the temperature but also to set the desired value of the thermostat or trigger a motor to open a window. Literature [1] Liang et. al. „OGC SensorThings API Part I: Sensing“ OGC® Implementation Standard, 2016 [2] Fraunhofer IOSB SensorThings- Server: https://github.com/Fraunho- ferIOSB/SensorThingsServer [3] SensorThings API GitHub page: https://github.com/opengeospatial/ sensorthings 5 1

1 SAFEWATER Innovative tools for the detection and mitigation of CBRN-related contamination events of drinking water The European FP7 project SAFEWATER has developed a comprehensive event detection and event manage- ment solution for drinking water security and mitigation against major deliberate, accidental or natural CBRN-related (chemical, biological, radio-nuclear) contaminations. The key module is the Event Manage- ment System (EMS) which handles incoming events and provides decision support in case of a crisis. The Event Detection System (EDS) detects potentially dangerous constellations of water quality parameters. In case of an event, it is important to provide rapid decision support regarding the best mitigation measures (e.g. opening/closing of valves). Online response tools can predict the spread of the contamination and calculate optimum measures to minimize the impact of the contamination. The simulators can also be used in an offline context to train operational staff. Furthermore, the simulators can be used to train the event detection system. Task description The European FP7 project SAFEWATER [1,2] has developed a comprehensive event detection and event management solution for drinking water security and mitigation against major deliberate, accidental or natural CBRN-related contaminations. Fig. 1 provides an overview of the structure of the SAFEWATER system. Fraunhofer IOSB developed the Event Management System (EMS) which handles incoming events and provides decision support in case of a crisis (as well as for routine operations). Furthermore, IOSB contributed to the simulators which are able to simulate the hydraulic state and water quality parameters in the drinking water network. The simulators can be used offline (with historical data) and online (using real-time sensor data as input for the simulator). In case of an event, online response tools can predict the spread of the contamination and calculate optimum measures to minimize its impact. The simulators can also be used in an offline context to train operational staff. Furthermore, the simulators can be used to train the event detection system. Result description The Event Management System (EMS) provides a platform for efficiently managing response actions during a contamination event [3]. Alarms produced by several sources, such as event detection algorithms and customer calls, are collected by the EMS and presented on a web- based interface. Human operators evaluate the active alarms and initiate the execution of the response procedures if a possible threat is detected. After a contamination event has Contact: Dr.-Ing. Thomas Bernard Phone +49 721 6091-360 thomas.bernard@iosb.fraunhofer.de Systems for Measurement, Control and Diagnosis www.iosb.fraunhofer.de/MRD 5 2

2 been declared, the EMS serves as the central point for collecting information and tracking the evolution of the incident by means of periodical situational reports and task management capabilities. A number of pre-defined tasks are automatically instantiated depending on the type of event. This initial set of tasks can be adapted and extended to better suit the current situation. Since the system is fully web-based it can also be accessed from mobile devices used by technicians in the field. 1 Structure of the SAFEWATER system, ©ARTTIC. 2 Simulation of the spread of a contamination and visualization via a web-based GIS. Offline Simulators: An enhanced and easy-to-use water quality simulator has been provided based on the open source simulator EPANET-MSX [4]. The quality simulator can be used offline based on historical hydraulic data or online in order to predict the spread of contamination (lookahead simulator). For online usage, the SIR 3S hydraulic online simulator is required. Online Simulators: The online usage of the hydraulic and water quality simulator supports optimized operation of the distribution network and provides decision support in case of a contamination event. “Lookahead” simulations can be performed to predict the spread of the contamination, calculate possible locations of the source and identify valves which have to be closed to minimize its impact [4]. The simulation tools are connected to the Event Management System (EMS) of the SAFEWATER solution so most of the visualization of the results and the parameterization of the modules is performed via the web browser-based EMS. A sample result of the prediction of the spread of a contamination is shown in Fig. 2. Project description The SAFEWATER solution has been implemented, tested and evaluated at three water utilities (HaGihon - Jerusalem, WVZ – Zurich and AdA - Portugal) [1]. Six use cases in the SAFEWATER project were designed to guide the SAFEWATER solution by setting up a number of real-life scenarios of contamination events likely to challenge municipal water supply systems. The use case scenarios were later used to test the effectiveness of the SAFEWATER solution components in dealing effectively with the use cases. The features and functionality of the SAFEWATER solu- tion were demonstrated in a live demo at a test network run by the water utility WVZ (Zurich) in 11/2016. In the future, there are plans to install and enhance the SAFEWATER solution at further water utilities. Thomas Bernard (Fraunhofer IOSB) was scientific coordinator of the project. Project Partners Hagihon Ltd. (Israel), Aguas do Algarve SA (Portugal), Wasserversorgung Zürich (Switzerland), 3S Consult GmbH (Karlsruhe), Decision Makers Ltd., (Israel), CEA-LIST, (France), ACREO AB (Sweden), BioMonitech Ltd., (Israel), ARTTIC (France) Project execution Dr.-Ing. T. Bernard, Dr. J. Moßgraber, Dr.-Ing. C. Kühnert, Dr. C. Janya-Anurak, E. Santamaria Literature [1] http://safewater-project.eu; https://github.com/FraunhoferIOSB/ SensorThingsServer [2] Bernard, T.; Moßgraber, J.; Elinge Madar, A.; Rosenberg, A.; Deuerlein, J.; Lucas, H.; Boudergui, K.; Ilver, D.; Brill, E.; Ulitzur, N.: „SAFEWATER - Innovative tools for the detection and mitigation of CBRN related contamination events of drinking water.“ 13th In- ternational Conference on Compu- ting and Control for the Water In- dustry (CCWI) 2015, Leicester (UK). Procedia Engineering 119 (2015), S.352-359. ISSN: 1877-7058. DOI: 10.1016/j.proeng.2015.08.895 [3] Santamaria, E.; Moßgraber, J.; Deuerlein, J.; Kühnert, C.; Bernard, T.: "An integrated system for enhanced response manage- ment in CBRN related contamina- tion events of drinking water". In: Proc. 14th International Confe- rence on Computing and Control for the Water Industry (CCWI) 2016, Amsterdam (Netherlands). 7.-9.11.2016 [4] Bernard, T.; Kühnert, C.; Santamaria, E.; Moßgraber, J.; Deuerlein, J.; Guth, N.; Meyer- Harries, L.; Ovadia, L.; Rosenberg, A.: "Online Hydraulic and Water Quality Simulator as a Tool for Contamination Event Response". In: Proc. 14th International Confe- rence on Computing and Control for the Water Industry (CCWI) 2016, Amsterdam (Netherlands). 7.-9.11.2016 5 3

B U S I N E S S U N I T B U S I N E S S U N I T VISUAL INSPECTION Spokesperson Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 Business Unit Development Dipl.-Ing., Dipl.-Wirt. Ing. Henning Schulte signal processing for the purpose of quality assurance and / or increasing productivity in real time that come into play when “seeing” is the solution of choice. “Seeing” in this context refers not only to what the human eye is capable of, but also includes the entire electromagnetic spectrum from UV to IR as encountered in the natural and technical world. The technical solutions offered cover a broad service portfolio, ranging from feasibility studies to process developments, practical validation up to and including demonstrators and productive systems that can be used at the customer’s site. Phone +49 721 6091-275 Markets “Seeing” relevant information forms the basis for our solu- tions. In a technical respect, this generally comprises image acquisition using line scan or area cameras and image analysis in real time. Whether the task is to rapidly monitor a large number of moving parts while sorting bulk goods (in order to separate desirable parts from undesirable ones), detect changes in the reflective properties or the texture of a surface (which are indicative of product defects or process defects) or classify objects or object groups (to detect divergences from specifications), we are able to offer tailored solutions to our partners and customers. Whenever the task is to “sort” large quantities of parts (e.g. bulk goods) in the material flow and in real time or to verify the compliance of complex individual parts with specifications – whether in terms of color, shape or material characteristic – our solutions are put into practice. The solutions we develop are used in recycling glass or enriching minerals to the same extent that they are used in sorting tea, coffee and other foods. Mission and vision Replacing the five human senses with a wide range of technical sensors is something we do on a daily basis. This is especially true when it comes to acquiring more accurate information or doing so faster than humanly possible; or if we want to use a technical device to replace or assist a person performing a given task. In the Visual Inspection business unit, Fraunhofer IOSB gathers all activities in the field of sensor technology, image analysis and 5 4

1 Food Sorting System in action. In the inspection of reflective surfaces, we specialise in the recognition of defects for technical but also aesthetic purposes. Defect sizes can be given in absolute or relative terms, and sophisticated classifications are available for grading. We also offer help and simulations for the layout of testing stations. Sometimes “taking a look inside parts” or simply “seeing through them” is helpful when it comes to recognizing constituents or divergences. If light can be used to make them visible or the materials being searched for have specific reflective properties, we find them. We also offer solutions for special problems such as “seeing” vibrations from far away, “seeing” in an adverse environment (e.g. in deep-sea envi- ronments) or recognizing objects for identification purposes. References / product highlights • Binder+Co AG: Systems for sorting recycling glass; recognizes heat-resistant glass containing lead • SALUS Haus GmbH & Co. KG: Systems for sorting tea and herbs; color, size and debris sorting • PETKUS Technologie GmbH: Sorting of seed • Uhlmann GmbH: Blister inspection • GREIWING logistics for you GmbH: Sorting system for plastic granulates • Zwiesel Kristallglas AG: Inspection of glass lenses for occlusions and air bubbles • Eti Maden General Directorate: System for sorting materials (colemanite) Equipment, lab and test facilities • De Beers UK Limited: Systems for finding diamonds • Sliding tables with a variety of lighting facilities for image acquisition • Experimental systems for sorting bulk goods (each equipped with a camera and blow-out unit) in various configurations as a belt sorter, channel sorter, sorter with chute and free- fall sorting 1 • Measurement stations for inspecting surfaces, e.g.photometric stereo or deflectometry • Measuring devices for 3D inspection • Test systems for transparent materials • Multispectral workbench • Lab equipment for characterizing materials • Microscopic image acquisition stations • Test lab with lighting technology • Fully-automatic BRDF measuring station • Experimental systems for underwater inspection • Cleanroom for inspecting sensible parts 5 5

1 GONIOMETRIC IMAGERY OF “LIVING SPARKLE” Effect pigments in colored coatings Effect pigments can create fascinating optical effects on the surfaces of solid objects. They consist of small flakes of metal, mica, polymer or other materials and are embedded in the lacquer layer. Based on optical reflection and interference effects due to varying illumination and observation angles, they can also cause changes of color, texture and gloss. Depending on the concentration of the pigments in the coating, the lac- quer appears either more homogeneous or more sparkling. Due to the properties of the effect pigments, this can lead to the so-called flop effect where the dominant color switches completely or to the living sparkle effect where single eye-catching flakes seem to be twinkling in the dark or even in other lacquer surround- ings. These effects are used in functional tasks, e.g. security printing, as well as many decorative applications in areas such as plastics, cosmetics, printed products, coatings or car paints and even food processing. Task The quantitative evaluation of effect pigment surfaces requires a methodical approach. To date, no universally accepted standard has been defined by a scientific committee or organization. Nevertheless, some suggestions and recommendations exist and the first gadgets for measuring the optical properties of effect pigments in layers have been presented by manufacturers of optical measurement devices. The manifold optical effects make it essential to consider a wide range of different aspects and a number of questions need to be resolved: • Angles of illumination and observation: fixed pairs of angles or movement, range of angles • Definition of the light source (spectrum, light intensity, diffuse or directional illumination) • Specification of the optical detector (single sensor, digital RGB-camera or spectrometer, spectral sensitivity and resolution, number of pixels and dynamic range, optical magnification, area of observation, sharpness and depth of focus at inclined observation etc.) • Analysis, processing and presentation of the measurement data, definition of characteristics, significant parameters and quantities (density, strength, number, color of sparkle, graininess, range of visibility, etc.) The IOSB was asked to support a major manufacturer of effect pigments in finding suitable parameters by testing different experimental conditions in order to capture the appearance of effect pigments in lacquers. Contact: Dr.-Ing. Dipl.-Phys. Alexander Schwarz Phone +49 7243 992-103 alexander.schwarz@iosb.fraunhofer.de Signatorics www.iosb.fraunhofer.de/SIG 5 6

2 3 Project Fraunhofer IOSB has excellent facilities for conducting extensive optical investigations as well as basic research into the optical properties of reflection and the appearance of samples. The project aim was to capture the living sparkle effect as well as possible. To achieve this, it was necessary to design and build a measurement setup which would subsequently enable the image to be evaluated and measure all the physical and statistical properties of the pigments described above. The angle-dependencies were examined with the help of a robot-based automated goniometer. This allowed the light source and the detector to be moved separately and independently of each other around the measurement sample, covering a wide range of angles. Several digital cameras with different pixel numbers, detector sizes, dynamic range and sensitivity were used for the test measurements. RGB-cameras were compared to a detection system consisting of a monochrome camera and an electrical switchable RGB-filter. In addition, the influence of varying beam-spread angles on the appearance of the coating was tested on an optical bench. Since the observed flakes are so small (only a few microns in diameter), the detection unit has to be very sensitive to optical aberrations such as defocus, spherical and chromatic aberration. As a result, some faults or flaws in the cameras were exposed in the images. Therefore, the use of high quality optical components was crucial as well as careful adjustment during the measurement process. Result Several samples with living sparkle effect have been measured under a variety of conditions. After comparing and evaluating a number of different measurement parameters, a setup consisting of a tungsten lamp with broadband spectrum, an electrical switchable RGB-filter and a monochromatic camera was recommended for the acquisition of high-quality images intended for subsequent image evaluation. The linearity of the selected camera was verified with regard to exposure time and light intensity. During the test series with varying illumination and observation angles it became apparent that the dynamic range of the camera was not sufficient in some situations. Consequently, the exposure times of the camera had to be adapted to avoid saturation of single sparkles and to guarantee an optimal dynamic range even at very small inclination angles. Furthermore, multiple measurements with a reference white panel were recommended for noise reduction and calibration purposes. 1 Object with effect pigment coating. 2 Image of a coating with effect pigments showing living sparkle effect. (© Merck). 3 Automated goniometer at the Fraunhofer IOSB used for the measurements. Customer Merck KGaA, Darmstadt Project execution Dr.-Ing. Dipl.-Phys. Alexander Schwarz, Michael Kremer, M. Sc. Markus Richter, B.Eng., Sergio Bayon, M. Sc. (Uni. Alicante, Merck KGaA) 5 7

1 PuritySurf Ellipsometric inline inspection of objects with nonplanar surfaces Overcoming the geometric restrictions of state of the art ellipsometers, the patented Retroreflex-Laserscan- ning Ellipsometry [1] can detect changes of the state of polarization in or at test objects with flat or curved surfaces. It provides high resolution in combination with high speed image acquisition in a large measure- ment field and is therefore ideally suitable for inline applications. As well as changes in polarization, it can also detect changes in transmittance or reflectance resulting from defects (bubbles, inclusions, cracks etc.). Hence this measurement method allows the qualification of objects, surfaces or coatings regarding aesthetic or functional criteria as well as the material quality. In many industrial production processes ellipsometric measurements can now be used for the first time. The inspection method was verified with a demonstrator (Purity-Surf), described here in detail. Task description Objects with tightly controlled physical properties are becoming more and more important in industrial production processes. To improve the production of high quality objects or surfaces, measurement systems are necessary that allow a 100% inspection of their physical properties. Ellipsometry is a reliable and very sensitive method for measuring the optical properties of objects. Polarized light illuminates the object. Within a separate receiver the intensity and state of polarization of the reflected or transmitted light from the test object are measured. From these values the optical properties of the inspected object element are calculated by using a physical model of the sample. The model takes account of the test configuration (mainly the angles of incidence) and the physical structure of the test object (object model). The relevant parameters of the object model are: - the refractive index, - the birefringence, - the extinction coefficient, - the dichroism, - the depolarization - and the path length through the material, if applicable. In principle, a set of these model parameters can be measured, if the other parameters are given. Conventional ellipsometry requires an extremely precise alignment of transmitter, object and receiver relative to each other to even get measurement signals. Hence, it is an estab- lished laboratory method but only in special cases used for inline applications. Contact: Dr. Matthias Hartrumpf Phone +49 721 6091-444 matthias.hartrumpf@ iosb.fraunhofer.de Visual Inspection Systems www.iosb.fraunhofer.de/SPR 5 8

2 Result description Fraunhofer IOSB has developed and experimentally verified a measurement method which overcomes the geometric restrictions of conventional ellipsometry. Figure 2 illustrates the principle based on an evaluation of retroreflective beam paths: the transceiver (receiver and transmitter combined to a single unit) emits a laser beam which first reflects off the surface of the sample and then hits a retroreflector. The reflective film used in the setup does not alter the state of polarization regardless of the angle of incidence (up to approx. 30°) and reflects the incoming beams without any displacement back towards the sample. After reflecting off the surface of the sample again, the beam finally reaches the detector. In this configuration, the retroreflector automatically fulfils the reflection condition for a large range of angles and heights of the test object. It overcomes the geometric limitations of standard ellipsometers and opens the way for new industrial applications of ellipsometry. Alignment of the sample orientation and position to less than 1° resp. fractions of a millimeter relative to the sensor components is no longer necessary to get measurement signals. Project description A prototype (PuritySurf) for the ellipsometric characterization of materials in industrial processes has been realized. It scans the surface of the test object point-by-point with a laser beam and a sampling frequency of 4 MHz. A deflector unit changes the direction of the laser beam in such a way that it projects a laser line, onto the sample surface while ensuring that the individual light beams are aligned parallel to each other. The line scan frequency is 1 kHz. For each scanned object element, the change in polarization of the reflected or transmitted light is measured simultaneously with several polarization channels. The changes in intensity and polarization caused by the sample are calculated from the measured intensities. The result is a number of polarization images (Fig. 3) which can be used to determine material properties with high spatial resolution. In contrast to conventional realizations of imaging ellipsometers the prototype provides a wide field of view (line width > 13 cm) and is tolerant against positional and angular movements of the samples. Using a special laser focusing system the demonstrator produces sharp images of small structures (down to less than 100 µm) with a large depth of focus. Decorative defects, flaws in the material or the film and inhomogeneities can be visualized and detected in high definition. The principle enables for the first time the performance of ellipsometric measurements in several industrial applications, e. g. tensile forces during the production of glass tubes, layer thicknesses on varnished automobile parts, coated metal surfaces or optical components. Precise ellipsometric measurements require that the angle of incidence onto the test object is given to a sufficient degree of accuracy for each measurement point (e.g. by CAD-data). If absolute values are not essential (e.g. when testing homogeneity or comparing the sample with a “good” object), a knowledge of the geometry is often not required; an analysis of the homogeneity or a comparison of the acquired images is often sufficient to solve these tasks. 1 Beam path of a conventional ellipsometer when the reflec- tance condition is fulfilled (left) or not fulfilled (right). 2 Image of the retroreflex beam path with double reflec- tion at the sample surface. 3 Polarization image of a varnished plastic test object acquired with the prototype scanner. 3 Development and marketing partner: Sentech Instruments GmbH Project execution Dr. Matthias Hartrumpf, Dipl.-Inform. Christian Negara Literature [1] Hartrumpf, M.: Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien DE 10 2010 046 438 A1, WO 2012/038036 A1, EP 2 848 916 A1 [2] Negara, C.; Hartrumpf, M.: Ellipsometrie an gekrümmten Ober- flächen. In: Puente León, Fernando, Heizmann, Michael (Hrsg.): Forum Bildverarbeitung (2014), KIT Scienti- fic Publishing (2014), S. 227-238 5 9

1 BAUCYCLE Recycling of construction and demolition waste with advanced sorting technologies The fine fraction of construction and demolition waste (C&DW) is a component often not considered in recycling efforts for these materials. Nevertheless, with five million tonnes of fine material being generated per year in Germany, this fraction makes up a significant proportion of C&DW. It is generally disposed of in landfill sites. BauCycle, an internal Fraunhofer-funded project, brings together four Fraunhofer institutes with the aim of developing new strategies for recycling fine fraction material. The development of advanced optical sorting technologies for this fine fraction by Fraunhofer IOSB and the use of the sorted material in the production of innovative and functional building products are major goals of the project. However, BauCycle takes an even more comprehensive approach to the recycling process. It uses a number of tools, such as the geographic information system (GIS), to record relevant information in a database. This includes potential material banks (e.g. demolition sites) and sources of demand for the material (e.g. brick producers or cement plants). It also considers information about material logistics and supply chains for the develop- ment of an Internet-based market platform. Task description The construction sector is one of the most resource-intensive economic sectors in Germany. Each year, it consumes approximately 550 million tonnes of mineral-based raw materials. At around 100 billion tonnes, the entire stock of buildings is an important store of raw materials which can be recycled at the end of its service life. Around 50 million tonnes of demolition material is generated each year. A total of approx. five million tonnes of fine material (< 2 mm grain size) are produced per year in Germany. It is generally landfilled. Only about five percent of this material is suitable for the high-quality recycling on the product level. However, the ongoing discussions on the German government’s framework ordinance regulating the use of mineral replacement construction materials in technical buildings are making this situation increasingly interesting. A suitable recycling process is not yet available for these fractions, even though landfill capacities are becoming scarce and the primary sources of raw material for fine sand are mined close to their limits. Result description Recycling C&DW ecologically and economically is a challenging problem. Due to the heterogeneity of the materials and the technical and safety-related issues associated with fine-grained material flows, the industry requires advanced optical sorting technologies, Contact: Dr.-Ing. Robin Gruna Phone +49 721 6091-263 robin.gruna@iosb.fraunhofer.de Visual Inspection Systems www.iosb.fraunhofer.de/SPR 6 0

2 logistics concepts and product innovations which go far beyond the current technological level. All these needs are addressed by the BauCycle approach. The project is therefore an important step towards achieving sustainable reuse of C&DW material and a technological and logistical solution for the circular economy in the building industry in general. The following specific solutions are being developed and will be made available: advanced optical sorting technologies for sorting fine-grained materials by color and reflectance features in the shortwave infrared (SWIR) spectral range (Fig. 3), an online marketplace that addresses the synchronization of demolition and construction sites using specific simulation algorithms, and innovative and functional building products made from recycled C&DW. Furthermore, the whole project is being evaluated and assessed by environmental and sustainability analysis. Project description A cooperation of four Fraunhofer institutes is working on solutions for the material hetero- geneity, technical and safety-related challenges surrounding the recycling process of C&DW. The recycling of the fine-grained waste fractions into production will ensure resource-efficient and sustainable management of raw materials and form the basis of an innovative recycling management strategy. To prevent an emphasis on downcycling applications, such as road con- struction, backfilling or even landfilling, the project envisages the use of the fine material in the production of innovative and functional building products (e.g. wall plaster, alkaline activated components or autoclaved aerated concrete). This is one of the goals intended to reintroduce the raw materials into the production cycle. The main aim of the project is to develop and establish a closed-looped for materials in the construction sector. Fraunhofer IOSB is developing advanced optical sorting technologies for material-specific sorting (Fig. 3), Fraunhofer IBP and UMSICHT are seeking to develop new materials and products made from demolition material and Fraunhofer IML is pursuing a platform-based reorganization of the market. Further, the knowledge and expertise of all partners is focused on assessing the ecological impact. In the first step, mixtures of pure C&DW components are being used to evaluate different approaches to the development of new products. Functional building elements, such as sound absorbing wall tiles, cement-free binder alternatives or porous lightweight bricks, are some of the materials in focus. Next, successful approaches will be tested with real C&DW collected from different recycling sites. To enable C&DW to become widely used in the production of new building materials, material-specific sorting of the C&DW is essential. Fraunhofer IOSB is developing advanced sorting technologies based on optical computing for this purpose (see Fig. 2). In parallel, novel logistic concepts for material transportation are being developed. These consider the local and regional structures of the construction and demolition market. 1 C&DW flow according to the BauCycle approach. 2 Advanced optical sorting technology based on problem- specific optical filters. Project execution Dipl.-Ing. Günter Struck, Dr.-Ing. Miro Taphanel, Jürgen Hock, M. Sc. Dr.-Ing. Robin Gruna Literature [1] Dittrich, S., Dörmann, J., Gruna, R., Nühlen, J. und Thome, V. (2016). „Das Verbundprojekt BauCycle — Von feinkörnigem Bauabbruch zu funktionalen Bau- materialien und Bauteilen, Band 3“. In: Mineralische Nebenprodukte und Abfälle, S. 455-463 6 1

B U S I N E S S U N I T B U S I N E S S U N I T DEFENSE Spokesperson Content Dr. rer. nat. Michael Arens Phone +49 7243 992-147 The IOSB’s core competency lies in research into optronic systems for human and computer vision, real-time processing and analysis of imagery, and full-motion video as well as the necessary information and communication technology for the use of images in network-enabled operations. Of special significance for the German armed forces is our research and technology work in the following areas: • Design, evaluation and protection of existing and future optical and optronic sensor systems: daylight and night vision, hyperspectral sensing, laser-based sensors and protection against laser threats. Coordinator • Warning sensors, propagation of light through the Dr. rer. nat. Jürgen Geisler Phone +49 721 6091-262 or +49 7243 992-109 atmosphere, signatorics for reconnaissance and protection, concepts for and evaluation of camouflage, concealment and deception. • Network-enabled interoperable real-time processing and analysis of imagery for purposes ranging from wide-area imaging reconnaissance to target detection in weapon platforms, including human-system-integration. • Computer assisted object and situation recognition and image-based methods for object tracking and target handoff. • System architectures for networked simulation and gene- ration of terrain and building models for simulator-based training. Mission For the benefit of Germany’s defense as part of Europe and NATO the Fraunhofer IOSB supports the German ministry of defense and its subordinate authorities as well as the defense industry with applied research and technology on the areas of imaging with optronic systems, image and signal analysis, and architectures for simulation and information systems. Rapid transfer of our research results in order to enhance the ability of the armed forces and to protect our soldiers is our prime objective. The research and technology activity of business unit Defense is carried out in three tiers: • To support the ability of the German ministry of defense (GMOD) and its subordinate authorities for analysis and evaluation of defense-related technologies the IOSB conducts basic research that is funded by the GMOD in the long term. • Based on this research the institute conducts technology projects of the GMOD with a medium-term horizon and specific objectives. 6 2

• Finally projects with the defense industry lead to solutions for the forces. These projects are carried out in close coor- dination with the GMOD to ensure the independent role of the IOSB as consulting entity for the government. • Airborne multisensor platform (VIS, LWIR and hyperspectral) • Coalition Shared Data (CSD) reference system to support integration & testing for STANAG 4559 implementations • MODEAS – Modular Drone Detection and Tracking System International cooperations based either on bilateral agree- ments, with contracts from the European Defence Agency (EDA), or common research activities in the context of NATO’s Science & Technology Organization (NATO STO) are continu- ously flanking our national defence research work. Reference solutions • ABUL – Full-motion video exploitation system for reconnaissance and surveillance (air, land, and sea) • VABUL – Video Database ABUL – database for change detection To the extent that military security classification does not prevent this, the R&T in business unit Defense is incorporated into the IOSB’s applied research for civil purposes performed by the other four units in order to achieve the highest benefit for all application areas. Equipment, and lab and test facilities • Environment simulation (e. g. for camouflage assessment) • Adaptive optics • Bidirectional reflectance analysis of materials • Airborne platform for imaging radiometrics (AirSIG) • Observer performance evaluation • Assessment of visual and infrared imaging systems • Optronic countermeasures • Vulnerability analysis of optronical systems and human eyes with regard to laser threats • Femtosecond laser lab • Human-computer interaction for image analysis (eye gaze, gesture, virtual and augmented reality) • InnoLab - Serious gaming for image analysis training • VIEW – Virtual Reality Lab • Federation of simulators • Distributed Network Battlelab (DNBL)- Connected confor- mance testing environment for implementations according to NATO Standards (STANAGs) • Avionic ABUL for manned airborne platforms on the Hensoldt Mission Computer • RecceMan®: Interactive recognition assistance for aerial and satellite imagery reconnaissance • i2exrep (interactive ISR Exploitation Report) - Interactive application for generating and editing formatted reports, in (Joint) ISR (Intelligence, Surveillance, and Reconnaissance) • SAR-Tutor – E-Learning-tool for image analysis training • ViSAR – Simulator of geometric SAR-effects • Lost Earth 2307 – Serious Game for aerial and satellite image interpretation • Computer-Aided Interactive Performance Evaluation Tool CARPET for camouflage assessment • OpenCASE – camouflage assessment software • OMSIS: Onboard Infrared Ship signature Management system • Digital Map Table for reconnaissance and situation analysis • CSD – Coalition Shared Data Server and Clients according to STANAG 4559 for interoperabledata and information dissemination • DBED (Datenbaum Editor) – Software to create and maintain a database containing target categories conform to STANAG 3596 • Predicition tool for thermal imaging based on a Thermal Range Model (TRM 4) • Environment measurement system for characterization of • SAR simulation (CohRaS®: Coherent Ray-tracing based atmospheric effects SAR-Simulator) • GERTICO: Infrastructure for federated simulators • Reconnaissance and surveillance with mobile sensor swarms 6 3

1 SENSOR SIMULATION AT FRAUNHOFER IOSB Addressing challenges in the assessment and development of modern optronic imagers As image processing increasingly become an integral part of imaging devices, optronic imagers are becoming a complex and inseparable unit of hardware and software for the user. The image-based algo- rithms employed may enhance the output image or possibly adulterate its content without the observer being aware of it or having full control over the process. To address the need of the defense industry and gover nment departments for a well-founded evaluation and comparison of such optronic imaging systems, Fraunhofer IOSB has started to extend its existing range of simulation tools and develop approaches for image-based imaging device assessment. Introduction Imager performance is quantified in reconnaissance applications by the maximum range at which an observer can fulfil his task, e.g. the detection of an object in the scene. Thus, the performance assessment of optronic imagers has to take into account the entire optronic chain (Fig.1) including the scene, atmosphere, imaging device, (digital) signal processing, display and the observer. IOSB has many years of experience in determining the range per- formance by either simulations, lab measurements or field trials. For instance, the analytical model TRM4 [1] developed at IOSB is used for optronic imager comparison in various NATO states. The well-established lab measurement techniques and simulations are being challenged by increasing usage of image-based algorithms, such as turbulence compensation and local con- trast enhancement. Such techniques cannot be directly included in analytical models as these models are based on an abstraction of the scene (the target and background are replaced by an appropriate bar pattern, see Fig. 2), which allows range calculations without referring to an actual image. Approach Fraunhofer IOSB is addressing the need for a novel imager performance model within the ECOMOS (European Computer Model for Optronic System Performance Prediction) project in co-operation with research institutes and industry from France, Italy, the Netherlands and Sweden [2]. The project aims to create a harmonized European model for performance assessment that is capable of handling image-based signal processing. ECOMOS combines Contact: Dr. rer. nat. Dipl.-Phys. Stefan Keßler Phone +49 7243 992-201 stefan.kessler@iosb.fraunhofer.de OPTRONICS www.iosb.fraunhofer.de/OPT 6 4

2 2 and integrates the French atmosphere model MATISSE, the Dutch TOD (triangle orientation discrimination) model as well as TRM4 and the image-based simulation OSIS from IOSB. Imagers are specified via the TRM4 GUI and the range calculation is done either using the analytical path (TRM4) or the image-based path. In the latter case, the image-based simula- tion is employed to generate images similar to those the actual imager would produce. This is done by a step-wise degradation of a pristine input image, which represents the scene, along the optronic chain and may include image enhancement algorithms or even proprietary image processing modules (Fig. 3). Currently, only TOD test patterns are used as scene repre- sentatives and the range performance is determined by a human visual system model based on correlations between the input and output of the image-based simulation. In June 2017, the first ECOMOS workshop was held with interested European industry and administration representatives at IOSB in Ettlingen where the ECOMOS software structure and envisaged result options were presented. In addition to simulation tools, laboratory measurement techniques also have to be extended to cope with imagers using image-based signal processing. These techniques should be based on a test suite of images that is presented to the imager. The imager performance is then evaluated by means of the image quality of the resulting output images. With this in mind, IOSB has equipped a test site where IR images or dynamic scenes, which are generated by a high-resolution IR scene projector, can be presented to thermal imagers. Moreover, first results regarding the composition of the test suite and suitable image quality assessment metrics were obtained by using image-based simulations of thermal imagers and a large number of input images. Different image quality assessment metrics were compared regarding their applicability for real images with different levels of noise and blur [3]. A new approach for the estimation of image blur based on convolutional neural nets was developed and tested [4]. Compared to other blur metrics, trained models can make noise-insensitive blur estimates over a wide range of noise levels. Regarding the analytical model TRM4, a request has been received for it to be used in system design optimization, in trade-off studies or within other software simulations. Such applica- tions were not possible or cumbersome with previous TRM versions as they were designed having a user in mind who specifies one optronic system via the GUI and calculates its range performance. This situation has changed with TRM4.v2 released in June 2016. IOSB provides now customized TRM4.v2 versions that can be directly run from user applications or in batch processing mode. 1 The optronic chain. 2 Analytical models: scene abstraction by an equivalent bar pattern. 3 Generation of output images in the image-based simulation. Partners TNO (The Netherlands), ONERA – The French Aerospace Lab (France) Literature [1] Keßler, S.; Gal, R.; Wittenstein, W.: “TRM4: Range performance model for electro- optical imaging systems“ in Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXVIII, Proc. SPIE 10178, 101780P, 2017 [2] Repasi, E.; Bijl, P.; Labarre, L.; Wittenstein, W.; Bürsing, H.: “The European computer model for optronic system performance prediction (ECOMOS)” in Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXVIII, Proc. SPIE 10178, 101780O, 2017 [3] Wegner, D.; Repasi, E.: ”Image based performance analysis of ther- mal imagers” in Infrared Imaging Systems: Design, Analysis, Model- ing, and Testing XXVII, Proc. SPIE 9820, 982016, 2016 [4] Wegner, D.; Koerber, M.; Repasi, E.: “Noise-insensitive no- reference image blur estimation by convolutional neural networks” in Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXVIII, Proc. SPIE 10178, 101780G, 2017 6 5

1 SONAR FOR THE DETECTION OF MARITIME THREATS Evaluation of Side-Scan Sonar for Mine Detection Sonar systems have been used for imaging and mapping the seabed for several decades. Their continuing popularity is based on the wide range of possible applications in both the civilian and military sectors. In addition to various types of surveys and bathymetry measurements, imaging sonar can be used in maritime archaeology, environmental monitoring, search and salvage operations, for the discrimination of different seabed materials, debris detection and many other areas. But of greatest importance is arguably the military a p p l i c a t i o n o f s o n a r f o r M i n e C o u n t e r m e a s u re O p e r a t i o n s ( M C M ) re g a rd i n g n a v a l m i n e s . Wa t e r w a y s , s h i p p i n g lanes and the areas around oil rigs, offshore wind farms and pipelines need to be maintained and kept safe, while naval mines dating back as far as the Second World War remain a threat to this day, particularly in the English Channel. Task To counter the threat posed by naval mines and reduce risk to personnel, Autonomous Under- water Vehicles (AUVs) with high-resolution side-scan sonars are used to carry out preliminary surveys of potentially hazardous areas. After a scan has been completed, the detection and classification of mine-like objects is conducted offline while the actual identification and neutralization of potential targets is executed in a separate minehunting operation with the aid of remotely operated vehicles. The performance evaluation of minehunting operations is an ever-active topic of research. For this, the so-called Percentage Clearing (PC) is an important quantity as it describes the percentage of mines that were correctly detected, classified and neutralized during a given operation and depends strongly on the Probability of Detection and Classification (PDC) within a given region. The doctrine currently used to quantify the PC was conceived specifically for forward-looking sonar systems. Since it can neither readily nor reasonably be adapted for side-scan sonar systems, a new model is required that provides appropriately for all the main factors influencing and impairing the PDC. The goal of our work at Fraunhofer IOSB is to create a model that can predict the PDC of mine-like objects, automatically and reliably, solely on the basis of side-scan sonar survey data. Project description A reliable database of sufficient size and diversity is essential to support such a model. However, it is unlikely that the necessary volume of sonar data can be acquired the normal way for any Contact: Dipl.-Math., M. Sc. Claudia Hübner Phone +49 7243 992-252 claudia.huebner@iosb.fraunhofer.de Signatorics www.iosb.fraunhofer.de/SIG 6 6

2 3 specific mine-type. As a consequence, synthetically enhanced data will have to be utilized. More precisely, 3D models of mine-like objects will be inserted into existing sonar imagery. To achieve convincing results, the simulation of underwater signal backscattering and attenu- ation needs to be sufficiently detailed. Observer trials will be held so as to verify the quality of the synthetic data in addition to running tests with existing mine detection algorithms. Currently, the focus of our work lies on assessing the various influences on the PDC. Image quality, sharpness and signal-to-noise ratio (SNR) are among the more obvious and straight- forwardly quantifiable factors. Image complexity, on the other hand, can have a significant impact as well. The complexity of a sonar image depends greatly on the composition of seabed materials such as seagrass, rock formations and ripple structures. One reliable way to quantify image complexity is by exploiting image lacunarity, a measure for the "gappiness" of fractals which describes how patterns fill space. Differently put, it quantifies the heterogeneity of textures where patterns with more or larger gaps yield higher lacunarity values. Applied to sonar data, this means it can be used to characterize the seafloor in order to assess the cor- responding minehunting difficulty. Procedure In order to achieve convincing results when merging simulated mine-like objects with real sonar imagery it is necessary to understand the basic physics of sonar data first. During a survey, the seabed is scanned in a pattern consisting of (mostly) straight trajectories while including varying view angles and ranges. This means a single survey is usually represented by a large set of side-scan sonar images along with the corresponding navigational data for the AUV, e. g. GPS coordinates, altitude, water depth, heading, velocity, etc. Side-scan sonars emit conical sonic pulses in quick succession with a wide fan-shaped angle perpendicular to the sensor's path and a very narrow angle along its path. Only a moving sensor can create a sonar image: for each sonic pulse the intensities of the echoes are recorded, yielding a line in the resulting sonar image. Bright spots signify a strong signal reflection while dark shadows signify little to no signal reflection, usually because a larger object is occluding the shadowed area. This means that the length of a shadow contains information about the height of an object. However, one needs to take into account that pixel distances are not equidistant but dependent on the relative position of the sensor. Additional factors under consideration are the heading angle of the AUV at any given mea- surement position as well as horizontal beam spreading. The beam spread in particular implies there will be an overlap of echoes originating from successive sonic pulses. At what range the overlap occurs, however, depends primarily on the altitude of the AUV and its speed over ground but also on the heading angle. Furthermore, the scattering and absorbing qualities of the surrounding medium (seawater) need to be modelled as well as the reflective properties of the intended objects with regard to acoustic waves. 1 Diagram of side-scan sonar. (© Wikipedia) 2 Side-scan sonar image with varied seafloor type (ripple fields and rock formations). 3 Lacunarity map, dark blue indicates areas of homogeneity, dark red indicates heterogeneity. Customer This research is part of the projects MALM (Model generation for AUV performance evaLuation for Mine- hunting) and SOSES (Simulation of Objects in Side-scan sonar data for the Evaluation of side-scan sonar Systems), and commissioned and sponsored by the WTD71 (Tech- nical Center for Ships and Naval Weapons, Maritime Technology and Research) of the German Armed Forces. Project execution Dipl.-Math., M. Sc. Claudia Hübner, Dipl.-Inf. Patrick Dunau 6 7

1 ADAPTIVITY FOR GAME-BASED LEARNING Personalized Adaptive Learning for Military Image Interpretation Personalized adaptive lear ning for aerial image interpretation is essential for optimizing reconnaissance processes. Game-based lear ning concepts, e.g. serious games, could deliver a substantial contribution when combined with face-to-face training courses. W ith the “E-Learning A.I. (ELAI) Framework” Fraunhofer IOSB has developed a system to enhance existing simulations and serious games. The interoperability approach permits input analysis over multiple systems for adaptivity to users’ skills, knowledge and needs. The design of the E L A I F r a m e w o r k facilitates easy transfer to other game engines, computer simulations or serious games. Task description The interpretation of aerial and satellite images is one of the most important processes in the military Intelligence Cycle. It requires the detection, recognition, identification and analysis of structures and objects, according to a given task based on optical, infrared and radar imagery. Besides highly developed assets, sensors and image exploitation systems, the success of a reconnaissance mission depends on the interpreter’s analysis performance. Special face-to-face training courses blended with technology-enhanced learning tools, such as E-Learning courses, simulations and serious games, ensure that image analysts are qualified to a high standard. For optimum results, the training process must be well-adapted to the knowledge, skills and needs of the interpreter. Our application scenarios therefore focus on intelligent assistance and e-learning systems which help users to perform their image interpretation tasks effectively and efficiently. Adaptive serious games and computer simulations help to keep users motivated and ultimately improve the learning or training outcome. For simulations and games, user engagement can be enhanced by adapting the simulations and games to the user’s individual needs and by keeping the user immersed, e.g. by balancing the adaptivity inside the Flow Channel [1, 2]. Result description Fraunhofer IOSB developed the “E-Learning Artificial Intelligence” (ELAI) Framework [2] based on the 4-process adaptive cycle for adaptive learning systems. At its core, the ELAI has an intelligent tutoring controller which interprets the collected data (analysis phase) and adjusts the simulations or games accordingly (select phase) [2]. The captured interaction data is transformed into machine interpretable information in the interpretation engine by applying Contact: Dipl.-Inf. Alexander Streicher Phone +49 721 6091-277 alexander.streicher@ iosb.fraunhofer.de Dipl.-Phys. Wolfgang Roller Phone +49 721 6091-247 wolfgang.roller@iosb.fraunhofer.de Interoperability and Assistance Systems www.iosb.fraunhofer.de/IAS 6 8

2 3 so called Didactic Factors and artificial intelligence techniques like clustering and collaborative filtering. Based on this information the influence engine selects pre-defined adaptation strategies to adapt the game to the current user state. Dynamic difficulty adjustment is one typical adaptation strategy in the area of image interpretation, e.g. increase difficulty by covering more of the image with dynamically created clouds. The ELAI Framework consists of an ELAI game engine adapter and an externalized ELAI Con- troller which hosts the actual e-learning “intelligence” with an interpretation and an influence engine. Since most of the actual e-learning logic can be externalized, only a minimal-invasive adapter has to be implemented. The underlying principles are based on commonly accepted standards, like the Experience API (xAPI) or the High Level Architecture (HLA), and on effective adaptive interoperability designs from Learning Management Systems (LMS) [3]. The ELAI adapter has been realized for the Unity, Havok and VBS3 game engines, however, the results are easily transferable to other game engines and applications. Project description Over recent years Fraunhofer IOSB has developed operational serious games as well as innovative game-based learning systems for the German armed forces: Lost Earth 2307 is a 4X-strategy game for optical, infrared and radar image interpretation. It is in operational use at the German training center for military image analysts. [4] (Exercise Trainer) is a concept as well as an implementation for modular, Web-based EXTRA training tools for complex, multi-institutional joint forces exercise scenarios. [5] SaFIRa (Seek and Find for Image Reconnaissance, adaptive) is a prototype implementation of an adaptive seek-and-find game for image interpreters. The game’s objective is to find objects (e.g. buildings, vehicles, etc.) in an interactive, geographic map from a top “aerial” view. [2] The ELAI Framework has been applied to instances of these tools to investigate the concepts of interaction data capture, analysis, selection and presentation. Initial user studies verified the feasibility of the architecture and future work could include further A.I. technologies and other games or simulations. The externalization of the user model and its interoperable characteristics allows for further learning analytics on the collected data. For instance, the A.I. techniques of clustering and collaborative filtering are used to automatically identify learner profiles and detect suitable learning materials or gameplay recommendations based on multiple user interaction profiles. The framework’s development continues and will include further application areas, e.g. extended adaptivity for the Exercise Trainer EXTRA and for a distributed image-sensor computer simulation. This also involves the extension to adaptive Virtual Reality (VR) assistance systems for aerial image interpretation. 1 ELAI Framework. 2 Lost Earth 2307. 3 Adaptivity Cycle. Customer Bundeswehr Technical Center for Information Technology and Electronics (WTD 81) in Greding Project execution Dipl.-Inf. A. Streicher, Dipl.-Phys. Wolfgang Roller, Dipl.-Inf. (FH) Daniel Atorf M. Sc., Ehm Kannegieser M. Sc., Dipl.-Inform. (FH) Anton Berger Literature [1] Streicher, A.: Personalized and Adaptive Serious Games, Enter- tainment Computing and Serious Games, International GI-Dagstuhl Seminar 2015, pp. 332-377 [2] Streicher, A.: Towards an Interop- erable Adaptive Tutoring Agent for Simulations and Serious Games, International Conference on Theory and Practice in Modern Computing 2015, pp. 194-197 [3] Streicher, A.: INTUITEL - Intel- ligent Tutoring Interface for Technol- ogy Enhanced Learning, Fraunhofer IOSB Annual Report 2013, pp. 74-75 [4] Roller, W.: Simulation Based Im- age Analysis with Serious Games, Military Scientific Research Annual Report 2013, pp. 20-21 [5] Streicher, A.: Scenario Assistant for Complex System Configurations, International Journal on Computer Science and Information Systems 9 2014, pp. 38-52 6 9

INFORMATION MANAGEMENT – COMBINED AND JOINT Standard development for multinational cooperation of forces Information superiority is a key factor in maintaining a nation’s security. As recent terrorist attacks have shown, planning starts well beyond national borders and long before the actual event. Military and civil surveillance systems produce huge quantities of data. Although this increases the probability that the relevant information has been gathered, it decreases the probability of identifying the important elements in time. The priority here is to find ways to identify the right (interpretable) information. In the domain of Joint Intelligence, Surveillance and Reconnaissance (JISR), the Coalition Shared Data (CSD) concept and its associated standards are the keys to creating more efficient, higher-level information management processes. Fraunhofer IOSB is a major player in the development of concepts and solutions as well as standardization activities. Task description Globalization has created complex economic and sociological dependencies over recent decades. The nature of conflicts has changed dramatically and nations are being confronted with a vast number of new threat scenarios. Knowledge superiority is a question of being able to get the right information at the right time to make the right decision and draw the right conclusions. Technology allows us to disseminate information in near real-time and enables both aggressors and defenders to act remotely and network over time and space. Technologies in the areas of sensors and platforms as well as network technology and storage capability have evolved to the level where mass data can also be easily shared and disseminated. To make use of these new capabilities, there is a need for systems and services that can interact with each other in a well-defined way. Compatible interfaces for data exchange and the ability to interpret the disseminated data correctly are the foundations of these processes. Information management can only be achieved if the participating actors can define common processes and create a common understanding of their overall goals. To achieve interoperability in such an environment, standard development is essential. Contact: Barbara Essendorfer, M. A. Phone +49 721 6091-596 barbara.essendorfer@ iosb.fraunhofer.de Interoperability and Assistance Systems www.iosb.fraunhofer.de/IAS Result description The CSD concept started with the sharing of fixed, finished data such as reports, images and video clips. Over time the scope was extended to include the ability to share mutable data – 7 0

1 such as we can encounter in collaborative business processes where multiple parties modify a common piece of data – and constantly changing data such as video streams. The concept is essentially based on having a network of physically distributed sites which are connected using the available network infrastructure. Among the sites, each node shares information about its persisted content using metadata entries. A global awareness of available data is achieved by distributing the metadata across all instances of participating sites using appropriate syn- chronization protocols. Combining this awareness with the ability to retrieve files on demand, ensures ubiquitous access capabilities for data stored on any of the sites in the entire network with reduced network traffic. CSD is based on STANAG 4559 and connected STANAGs (NATO Standardization Agreements), process descriptions and doctrines. It can be transferred to domains with similar requirements. To enhance situation awareness, higher level services are developed using semantic world models, data/information fusion and information quality management. Fraunhofer IOSB has developed systems and services for CSD on multiple levels. Project description Standard development with regard to interoperability is a complex task. On the one hand, it is necessary to agree a common standard that all involved parties can accept. On the other hand, the descriptions/specifications must be sufficiently detailed to enable an implementation of the standard that is truly interoperable. Also, aspects such as backwards compatibility must be taken into account to enable interoperability between different versions of the same stan- dard. In JISR, processes have to be supported through the use of different standards, so the compatibility between connected standards is an issue. The approach here was for a group of experts to analyze the standards within a multinational project, add documentation where necessary and have the standard implemented by different institutions and companies. The result was then tested in interoperability exercises on a technical and procedural level using simulated and, in a final stage, live data. The exercises were accompanied by a test team that documented the lessons learned. These were subsequently analyzed by the expert group and the whole process started again. The outcomes were adapted processes, specifications and information models. At the same time, the results were fed back into the standardization process, making them available for a wider community that also could influence the results and details of the specifications. The supporting multinational project has now been concluded and the final results are being consolidated by the Custodian Support Team of STANAG 4559. This is currently chaired by the German MOD and supported by technical experts from different nations, among them Fraunhofer IOSB for Germany. A testing capability is currently being developed to verify future changes made to the standard and provide the ability to assess implementations performed by different vendors. 1 From collection to dissemi- nation in JISR via the usage of connected STANAGs. Customer Bundesamt für Ausrüstung, Informationstechnik und Nutzung der Bundeswehr (BAAINBw) Project execution Barbara Essendorfer, M. A., Daniel Haferkorn, M. Sc., Christian Kerth, M. Sc., Philipp Klotz, M. Sc., Dipl.-Inform. Christian Zaschke, Dipl.-Inform. Achim Kuwertz, Dipl.-Math. Jennifer Sander Literature [1] Essendorfer, B.; Kerth, C.; Zaschke, C.: Adapting Interoper- ability Standards for Cross Do- main Usage, Proceedings of SPIE 10207, Next-Generation Analyst V, 102070E, 2017 [2] Zaschke, C.; Essendorfer, B.; Kerth, C.: Interoperability of Het- erogeneous Distributed Systems, Proceedings of SPIE 9825, Sensors, and Command, Control, Com- munications, and Intelligence (C3I) Technologies for Homeland Secu- rity, Defense, and Law Enforcement Applications XV, 98250Q, 2016 [3] Kuwertz, A.; Sander, J., Schneider, G.; Essendorfer, B.: An Architectural Framework for ISR Analytics. NATO Symposium on Architecture Assessment for NEC (SCI-254), Systems Concepts and Integration Panel 2013. Proceed- ings: Tallinn, 2013,13 pp 7 1

1 INVIDEON Fusion of infrared and video images for remote tower applications “Remote tower operations (RTO)” are currently a very rapidly emerging market. In Germany, Deutsche Flugsicherung (the national air traffic control organization) has plans to operate five German airports ‘remotely’. The cost-efficient collection, transmission, processing and presentation of relevant air traffic data at the RTO workstation is a vital component of this process. INVIDEON (“Infrared/Video Fusion for Remote Tower”) is a collaborative project funded by the German Ministry of Economics and Technology (BMW i). It aims to highlight the opportunities and advantages offered by the additional use of infrared (IR) cameras. IR cameras sense the heat radiated by objects which, for example, provides a better image in poor visibility (fog). As air traffic controllers are not familiar with IR images, it makes sense to overlay the video images in the visible and IR spectra. Task description Fusing TV and IR image data is an important part of the INVIDEON project. Fraunhofer IOSB has many years of experience in this field and already has processes and algorithms for the following specific tasks: • Process for fusing image data from different spectral ranges by local adaptation to the image content [1] • Process for automatically transferring a point or an object in a sensor’s image to the corresponding point or object in the image data from a different sensor [2]. Fig. 1 shows an example of a fused IR/TV image. In the color TV image (left), the person is difficult to see because it does not have sufficient contrast with its surroundings. In the IR image (center), the person is clearly visible from its body heat. In the fused image (right), the person is also clearly visible and the image retains the colors from the TV camera. These existing processes must be adapted to the specific objectives of the INVIDEON project. The need to use the image sequences from color TV cameras both for the visualization and automatic detection and tracking of objects is likely to pose a special challenge. In particular, the required fusion of TV and IR image data must be adapted to a special human-machine interface and the needs of air traffic controllers. Result description In a first measurement project, RDE GmbH and the Institute of Air Transport and Airport Research (DLR) recorded over 2 hours of image material at the DLR airport in Braunschweig Contact: Dr. rer. nat. Dipl.-Phys. Norbert Scherer-Negenborn Phone +49 7243 992-342 norbert.scherer-negenborn@ iosb.fraunhofer.de Object Recognition www.iosb.fraunhofer.de/OBJ 7 2

2 using two arrays of IR and TV cameras. This consisted of 16 IR and 10 TV cameras each covering a full 360° panorama. Each IR camera provided a sequence of images with a resolution of 640 x 480 pixels and a refresh rate of 30 Hz. The TV cameras provided image sequences with a resolution of 1920 x 1080 pixels (Full HD) and a refresh rate of 25 Hz. 1 Example of IR/TV fusion images, left: color TV, center: IR, right: fusion. The TV and IR image data were sourced from The cameras recorded a variety of scenarios relevant to air traffic controllers, e.g. take-offs and landings of small and commercial aircraft, overflights and circling approaches, rolling along the taxiway. From this total of 26 image sequences per scenario, matched series of panorama images were generated for the IR and TV images using time and location registration data and a fused IR-TV panorama was calculated. Fig. 2 shows one individual image from these three panoramas. The panorama images and the magnified sections of these images show a small aircraft taking off. The aircraft is visible for longer in the fused panorama (bottom, in Fig. 2) than in the TV panorama (above, in Fig. 2). Project description INVIDEON (“Infrared/Video Fusion for Remote Tower”) is a collaborative project which aims to develop and prove the feasibility and utility of displaying fusion image data collected by infrared (IR) and video (TV) sensors at a remote tower workstation. The project aims to integrate the various sensor data into an artificial panorama outdoor view for remote air traffic controllers. This view combines the advantages of both sensors and is superior to a purely video-based representation. These advantages include improved long distance visibility, a higher identification rate, more accurate automatic tracking and greater cost- benefit ratio. Automatic identification and tracking of objects based on IR and TV panoramas in airport operations are another innovation in the area of air traffic control. These processes aim to simplify the user’s job by alerting him automatically to movements on the ground and in the air and automatically tracking objects. This may be achieved by fusing live infrared (IR) and TV panorama images and using object identification and tracking algorithms. The images must be registered so the images from the various cameras can be overlaid or fused in other ways. This means that the images must be geometrically equalized and the times and locations matched – preferably accurate to the level of the individual pixel. Fraunhofer IOSB is responsible for the principal task of the project “TV-IR fusion” which also includes the registration process. The collaborative project INVIDEON aims to accelerate the introduction of the RTO concept and thus improve the efficiency of the air transport system. the benchmark data set [3]. 2 Result of the fusion of IR and TV panorama. Top: TV panorama. Center: IR panorama. Bottom: IR-TV fusion panorama. The magnified section shows a small aircraft in take-off. The aircraft is visible for longer in the fusion panorama (bottom) than in the TV panorama (above). Partners Rheinmetall Defence Electronics GmbH (RDE), Deutsches Zentrum für Luft- und Raumfahrt e.V. (DLR), DFS Aviation Services GmbH Project execution Dr. Norbert Scherer-Negenborn, Dipl.-Math. Gabriele Schwan Literature [1] Schwan, G.; Scherer-Negenborn, N.: “An Approach to Select the Appropriate Image Fusion Algorithm for Night Vision Systems”, SPIE Secu- rity & Defence, 21 - 24 September 2015, Toulouse, France, 2015 [2] Lemaire, S.; Bodensteiner, C.; Arens, M.: “High precision object geo-localization and visualization in sensor networks”, Proc. SPIE 8899, Emerging Technologies in Security and Defence; and Quantum Security II; and Unmanned Sensor Systems X, 889919, http://dx.doi. org/10.1117/12.2028734, 2013 [3] Davis, J.; Sharma, V.: "Back- ground-Subtraction using Contour- based Fusion of Thermal and Visible Imagery," Computer Vision and Image Understanding, Vol 106, No. 2-3, pp. 162-182, 2007 7 3

1 ROAD RECONSTRUCTION FOR SIMULATION TERRAIN DATABASES Supplementing vector data with information from aerial imagery Virtual simulation systems have proven their practical value as tools for education and training as well as the preparation and evaluation of operations. Driven by rapid advances in hard- and software for com- puter game products, simulation systems are now becoming an interesting tool for education and training purposes in terms of immersivity, versatility and depth of simulation. While there is significant overlap between games and simulations used for entertainment, on the one hand, and those used in the profes- sional sphere, on the other hand, there are some major differences, especially in the elements used for didactic purposes. The provision of simulation terrain databases is another key difference. Fraunhofer IOSB is researching techniques for generating simulation data from various types of sensor data with a high level of automation. It has produced a number of process categories for reconstructing terrain forms, vegetation and building developments. The processing of information concer ning road networks is a spe- cial case and described in greater detail below. Background Even a successful simulation, which has been popular over several product generations, can survive throughout its life cycle with only minimum changes to its terrain databases. Well-known examples include combat flight simulations such as “Falcon”, “Flanker”, “IL2 Sturmovik” or “Digital Combat Simulator”. The original versions of these games were launched in the 1990s and their current iterations are still essentially based on the same terrain data. Simulations used by the military, in contrast, must have access to new terrain data for operations at short notice. It is even possible that they must be used with terrains to which they have no access but must still be recognizable. Task The reconstruction of roads from aerial photographs has been a frequently and intensively addressed problem in the more recent history of geodesy, photogrammetry and remote sensing. Until now, no automatic and universally reliable solution has been found. The data used for research in this area is often taken from aerial photographs produced for land surveys. However, when generating databases for military simulation systems, it has to be assumed that the data available will be of lower quality. However, the input data need not Contact: Dipl.-Ing. Peter Solbrig Phone +49 7243 992-359 peter.solbrig@iosb.fraunhofer.de Scene Analysis www.iosb.fraunhofer.de/SZA 7 4

be restricted to aerial or satellite images. The task is thus to derive an updated transport network database using reconstruction, information fusion and all available data, e.g. vector maps containing transport network information. Results In principle, free data services around the globe mean that road network information in the form of vector data is available. However, it must be assumed that there are gaps and errors in the data. To mitigate these problems, Fraunhofer IOSB has developed methods which make it possible to detect signs of roads using aerial photographs or videos, e.g. captured by drones, and then use this information to correct or supplement existing vector data. These signs can be derived both from photographic and 3D information which can be calculated from photographs using modern reconstruction methods. The few uncertainties can be solved through integration into textured 3D models based either on public domain data sources or current sensor data. In cases where no information was available, state-of-the-art classification processes were used to perform the initial detection of roads. As many features can point to the presence of roads (low relative height, homogeneous, neutral color and texture, local planarity of the surface) but there are many exceptions for each of these features (bridges, conceal- ment, shadows, variety of road surfacing materials, etc.), rules-based approaches, e.g. threshold value decisions, are often ineffective. Instead these features are usually gathered over all pixels or segments into feature vectors. Rules are then learned using training examples from similar data materials according to which a feature vector is assigned to the category “road” or “non-road”. As feature vectors can have any number of dimensions and considerable computing power is required to calculate them, they should only be evaluated for some sections of the training data. This procedure is known as feature or variable selection and may be highly dependent on the learning process. For example, up to 3/4 of all features can be catego- rized as redundant or irrelevant without significantly impairing classification accuracy. Figure 2 above shows a typical result for segment-based road detection. The results can be improved even further by assigning neighboring instances (pixels or superpixels) to the same category with the assistance of a prior integrated into a complex optimization framework. 2 1 View of a semantic 3D model (comprising ground, buildings and trees) with marked and verified road network. The road network is based on freely available geographical data while the 3D model was recon- structed and textured using cur- rent sensor data (drone videos). Minor and major deviations are highlighted in yellow and red, respectively, while roads com- patible with the sensor data are highlighted in green. 2 Sensor data (true orthophoto and elevation image, left and center) and the result of seg- ment-based classification (white and green: correctly/incorrectly classified road segments, black and red: correctly/incorrectly classified non-road segments). Project financed Basic/self-financed research Project execution Dr.-Ing. Dimitri Bulatov, Dipl.-Inform. Gisela Häufel, Dipl.-Ing. Peter Solbrig, Dipl.-Inform. Peter Wernerus 7 5

B U S I N E S S U N I T B U S I N E S S U N I T SECURITY Spokesperson Dr.-Ing. Markus Müller Phone +49 721 6091-250 Business Development Dr.-Ing. Andreas Meissner Phone +49 721 6091-402 Mission The business unit Security focuses on the security needs of people, companies and authorities, wishing to protect against natural and deliberate threats. It comprises a broad range of interlinked competencies that deal with sensor sphere and optronic aspects as well as multimodal surveillance robotics (on land, at sea and in the air), the development of ultra-modern analytical methods, the sup- port of interoperable standards for the real-time exchange of information for risk detection and management as well as assistance in the situational analysis and human machine interaction in situation centers. 7 6 Considering that new technologies are being discussed in a controversial manner with respect to conflicting aspects of security needs and the desire for freedom, particularly if they are associated with surveillance, IOSB pursues the notion of »Privacy by Design«, which requires that privacy criteria are already accounted for during the design of the system. Furthermore the protection of industrial installations and production capabilities against cyber-attacks in the context of the »Industry 4.0« paradigm continues to receive strong joint attention by IOSB’s Security and Automation business units. The range of services extends from studies (e.g. for evaluation) to the realization of experimental systems or prototypes and, in individual cases, up to and including system development. In typical projects, the security researchers of Fraunhofer IOSB support customers in their efforts to improve their competitive position, addressing challenges previously considered too dif- ficult, enabling new product generations featuring innovations from the cutting edge of research. Markets The business unit Security serves customers from the private and public sector. The former includes security technology providers, security service providers and operators of pro- perties with critical security profiles. IOSB serves authorities at the federal, state and municipal level in the public sector, including emergency services, which aim to identify and evaluate new technologies in order to fulfill their duties. IOSB is available as a partner for specialized small and medium-sized companies as well as larger companies for the development of product innovations. It considers itself as research resource for companies, which would also like to benefit from new scientific results without maintaining their own research department. Scientists often take on demanding subtasks in large projects on behalf of compa- nies. System integrators integrate IOSB developments in their systems, for example based on licenses.

Prior to or after acquisition of their contracts, security service providers and IOSB discuss the possibilities for further increase in the efficiency and/or effectiveness of their work by means of using new technologies; if necessary, IOSB involves industrial partners for commercial development and 24/7 support of the systems. Providers of novel high-tech products, who want to offer their own customers assurance with respect to their performance claims, commission IOSB with lab evaluation and benchmarking tests, on the basis of which absolute and/ or relative conclusions relating to performance can be drawn. IOSB experts offer consultation to companies or authorities while they prepare invitations to tender for security systems, particularly when it comes to the issue of relevant new technologies. This particularly includes the evaluation of tech- nologies with respect to their suitability for certain objectives. Companies that intend to resort to publicly funded research projects in order to enhance their portfolio receive assistance by IOSB when it comes to identifying suitable funding programs and to preparing a proposal. During the course of a project, IOSB acts as a research partner. Furthermore, IOSB finds funding programs and suitable partners from industry for users in search of new technologies for their fields of activity. In a technological respect and according to the overall research proposition of Fraunhofer IOSB, methods and sys- tems for image exploitation are a core area, which are deve- loped for property surveillance in both indoor and outdoor areas. With its competencies, IOSB handles the entire chain from sensor-sphere data acquisition, sensor carriers and their automatic control for surveillance missions, analysis on an automatic or human-machine basis, multi sensor fusion, and situation analysis up to and including the use of information acquired in this manner for higher-level management support. Recently Counter UAS (unmanned aircraft systems) research and development activities have been high on IOSB’s agenda. System design in compliance with privacy protection is an explicit topic of research and part of the consulting portfolio of the business unit Security. Equipment, laboratory and test facilities • Comprehensive laboratory equipment for capturing the entire image processing chain, from sensors through analysis to interoperable information exchange • Innovative, powerful sensors, such as eye-safe gated viewing lasers, two-color infrared sensors, multi- and hyperspectral sensors, and remotely-sited laser vibrometry systems • Distributed test setups for multi-camera tracking and privacy-compliant video analysis in public spaces • Multimodal sensor platforms: Experimental robotics on land, at sea and in the air, and associated ground control stations (stationary and in vehicles) for mission planning and control in heterogeneous deployment networks • Experimental counter UAS system Recent Security Research Projects include: • A secure, modular and distributed mobile border control solution for European land border crossing points (MobilePass) • A harmonized, modular reference system for all European automated border crossing points (FastPass) • Innovative tools for the detection and mitigation of CBRN related contamination events of drinking water (SAFEWATER) • Surveillance: Ethical Issues, Legal Limitations, and Efficiency (SURVEILLE) • Prevention, protection and REaction to CYber attackS to critical InfrastructurEs (PRECYSE) • Security and interoperability in next generation PPDR communication infrastructures (SALUS) • Multi Sensor Based Recognition of Criminals in Crowds during Complex Police Missions (Muskat) • More Security for Soccer Events - Improving Communications and Optimizing Dialogue (SiKomFan) • Multi Biometry Based Forensic People Search in Mass Image and Video Data (MisPel) • Co-operative System Platform for Video Upload, Assessment, Semiautomatic Analysis and Archiving (PERFORMANCE) • Autonomy Kit for close-to-production Vehicles supporting Networked and Assisted Recovery of HazMat (AKIT) • Flexible Semiautomatic Exploitation of Mass Video Data (FLORIDA) • Assistance System for the Situation Aware Defense of Danger through Unmanned Aerial Systems (ArGUS) 7 7

1 PRIVACY-RESPECTING VIDEO SURVEILLANCE Making video surveillance respect users’ privacy while increasing security in public places Privacy-respecting video surveillance introduces a conceptual framework for lawful, smart video surveillance that enforces privacy-related constraints based on the current threat situation and the type of incident that has been detected. It constitutes the first step towards situation-dependent smart video surveillance and helps to increase security while protecting the observed peoples’ privacy. Task description Video surveillance systems are a powerful tool for improving public security and the prosecu- tion of crime. So-called smart video surveillance systems support the operator in evaluating video data. Image processing algorithms process captured live data and search for critical events, e.g., violence. Systems such as these are making video analysis algorithms for activity recognition, tracking, and biometric identification of persons a reality. However, while these developments aim to improve the effectiveness and efficiency of video surveillance, they coincidentally increase the diversity and intensity of intrusions into the observed individuals’ privacy and create new potential for misuse. Legal scholars agree that applicable data protec- tion laws, i.e. the German Federal Data Protection Act (BDSG) or the European General Data Protection Regulation (GDPR), do not sufficiently cover the technological evolution of smart video surveillance and demand further regulations. In this sense, they expect that the lawful operation of smart video surveillance will require effective mechanisms for protecting privacy and preventing misuse. Result description To cope with the privacy risk while still increasing security, Fraunhofer IOSB has developed a generic privacy-aware video surveillance architecture that operates in three distinct modes [1]. The ‘Default Mode’ is active most of the time. In this mode, no critical activity is observed and therefore the impact on privacy must be limited. The operator has only limited access to information and functionality, e.g., all video data is artificially pixelated. ‘Assessment Mode’ is activated once an algorithm, e.g., violence detection, or the operator raises an alarm. In this mode, the first indicators for a critical incident have been detected. The operator has access to extended information, e.g., high quality video streams, to assess the situation. ‘Investiga- tion Mode’ is activated once a suspected incident is confirmed. In this mode, a given event Contact: Dr.-Ing. Erik Krempel Phone +49 721 6091-292 erik.krempel@iosb.fraunhofer.de Interactive Analysis and Diagnosis www.iosb.fraunhofer.de/IAD 7 8

2 1 An operator uses the video archive to find the owner of a piece of luggage. 2 NurseEye data processing. Project execution Dr.-Ing. Erik Krempel; Dr.-Ing. Pascal Birnstill has been assessed as critical. The operator may therefore use the highest level of functionality to prevent further damage. Algorithms with a high privacy impact, e.g., automatic person tracking and biometric identification become available. Once the incident is resolved, the system changes back to ‘Default Mode’. Project description This generic architecture has been adapted to different scenarios. In the security-related scenario “Unattended Luggage” a smart video surveillance system is deployed at an airport. In ‘Default Mode’, video is captured and stored in a 24-hour archive that is not accessible by the operator. Additionally, an algorithm searches for unattended pieces of luggage. If one is detected, the algorithm activates the ‘Assessment Mode’ and alerts the operator. If the operator confirms the alarm, the ‘Investigation Mode’ is unlocked. Here, the operator has access to the video recordings of the last 15 minutes and can use them to find the person who dropped the piece of luggage. Once the operator has found the person, he activates a tracking algorithm that reconstructs where the owner went after abandoning the luggage. Depending on the results, the operator decides if the area must be evacuated, e.g. the owner left the area in a hurry, or if a security officer should inform the owner about his left behind luggage, e.g. in case the owner went to a nearby kiosk. Once the incident has been resolved, the system is set back into its ‘Default Mode’. In the safety-related “NurseEye” scenario, the system operates in nursing homes or hospitals [2]. In ‘Default Mode’, an algorithm designed to detect people falling to the floor processes all video data. If no fall occurs, the system deletes the video data immediately. If the system believes a fall has occurred, it activates the ‘Assessment Mode’. First, the nearest member of the nursing staff receives an alarm on his smartphone. When he accepts the alarm, the staff member is granted access to an anonymized video so he can check whether there is an actual emergency. If the alarm is confirmed, the system enters ‘Investigation Mode’. Here, the nurse has full access to the live video data to assess the current situation and decide on the optimum way to handle it, i.e. he decides if special equipment is needed. Once the faller has received help, the system returns to ‘Default Mode’ and deletes all the video data. Literature [1] Birnstill, P.: “Privacy-Respecting Smart Video Surveillance Based on Usage Control Enforcement”, Dissertation, Karlsruher Schriften zur Anthropomatik, ISBN 9783731505389, 2016 [2] Krempel, E.: “Steigerung der Akzeptanz von intelligenter Video- überwachung in öffentlichen Räumen”, Dissertation, Karlsruher Schriften zur Anthropomatik, ISBN 9783731505983, 2017 7 9

1 S²UCRE – SAFETY & SECURITY OF URBAN CROWDED ENVIRONMENTS Advanced Video-Based Crowd Monitoring for Large Public Events Current video surveillance systems still lack the intelligent video and data analysis modules that decision makers require to maintain full situation awareness in urban crowd environments. Augmented views of the area, especially crowd density estimations and behavior predictions, would be of enormous benefit to decision makers at mass gatherings. The research project S 2UCRE (Safety & Security of Urban Crowded Environments), funded by the German BMBF and the French ANR, aims to provide this capability. Fraunhofer IOSB is contributing its NEST-system [1], a research and prototype platform for distributed intelligent video-based monitoring, to the S 2UCRE project. It is also extending the project’s functionality with interactive decision support using video-based crowd monitoring. Sponsored by: BMBF Contact: Dr.-Ing. Erik Krempel Phone +49 721 6091-292 erik.krempel@iosb.fraunhofer.de Interactive Analysis and Diagnosis www.iosb.fraunhofer.de/IAD Sascha Voth M.Sc. Phone +49 721 6091-583 sascha.voth@iosb.fraunhofer.de Videoauswertesysteme www.iosb.fraunhofer.de/VID www.s2ucre.de 8 0 Project description The research project S²UCRE addresses the area of mass gatherings in complex scenarios and distributed urban environments. In such situations, the crowd is often inhomogeneous in terms of its density and motion dynamics. In addition, pedestrians are distributed over large areas. Moni- toring events is a challenge for law enforcement agencies (LEAs) even without disturbances. It is difficult to respond quickly to accidents, offensive behavior or crowd densities that trap people and endanger lives (often referred to as “panic situations”); preemptive measures seem impossible. To overcome these problems, the S²UCRE project aims to link crowd monitoring based on video analytics with simulation-based methods for short-term prediction of crowd behavior. Two specific events have been selected as scenarios: the Hamburg Harbor Festival (1.5 million visitors in three days) and the Cannstatter Wasen in Stuttgart (up to 4 million visitors). Furthermore, S²UCRE intends to bridge the gap between the macro level of crowd monitoring and observation of individuals or groups when there are reasonable grounds for suspicion. The project’s research on five interdependent support technologies for LEAs, event organizers, security staff and rescue teams will improve collaboration between the various stakeholders responsible for security. Studies on human factors form an integral part of the technical work packages and thus go beyond the level of accompanying research. In addition, a fundamental work package is dedicated to legal and ethical aspects. The S²UCRE demonstrator will integrate the support technologies and thus provide proof of concept for the predictive analytics tools. In particular, this will explore ways to guide crowds based on predictive simulation. The five technology areas are:

2 • Video-based crowd monitoring of distributed urban environments: crowd densities and 1 Overview of the concept crowd dynamics. • Short-term prediction of crowd behavior for fast and efficient evacuation. • Semi-automated suspicious behavior analysis for security applications. • Detection & (geo-) localization of perpetrators. • Self-localization of security and rescue team members and a communication platform for geo-registered information exchange between security and rescue personnel. In contrast to current projects, S²UCRE will not develop these technologies individually but focus research on integrating continuous workflows into a single system. This will combine real-time information on the current security and safety situation with a short-term simula- tion of the crowd behavior to prevent critical conditions arising. S²UCRE envisions an integrated surveillance and prediction system that addresses safety and security and is tested on concrete scenarios. Figure 1 shows the overall concept of S²UCRE. In addition, the diagram shows the synergies and logical connections between the components required for safety applications (red) and security applications (blue). The information flow and processing chain for safety scenarios is as follows: algorithms for video- based crowd monitoring and density estimation in the urban area (3) extract data and give them to short-term simulation for risk assessment (5). Here, geo-registered information on escape routes (4) and human factors analysis (2) are used to simulate evacuation scenarios. The results of (3) and (5) are displayed in the surveillance and prediction system (7) where they are assessed by human operators. In case of a critical situation, the human operator can send dedicated messages and action plans to security officers and rescue teams in the crowd (8), or the crowd itself (9). For security applications, the information flow is as follows: mobile cameras (6), and possibly drones (to be investigated) gather data that is displayed in the surveillance and prediction system (7) and observed by human operators. If the operators detect suspicious behavior, they activate the monitoring application in the surveillance and prediction system (7). The potential offender is then detected and tracked by the system (3). Information on offenders can be handed over to mobile security forces enabling them to approach the right person (8). Specifically, this includes the geo-location and high-resolution images of the offenders. As shown in Figure 1, S²UCRE covers the complete process chain from monitoring crowded urban scenes, risk assessment and situation awareness using geo-located observations to short-term predictive simulations and visualization for decision makers (Figure 2). In parallel, human operators use the sensor (camera) network for surveillance and can trigger response measures in case of reasonable suspicion. S²UCRE thus unifies two sets of system requirements and concepts, safety and security, on one platform. Ethical and legal aspects (1) are evaluated in a separate work package that will focus on the security scenario. and basic system components. German partners are responsible for the red and French partners for the blue components. 2 Visualization of crowd behavior in video streams and dynamic heat maps. Project execution Dr.-Ing. Erik Krempel, Sascha Voth M.Sc. Literature [1] Monari, E.; Fischer, Y.; Anneken, M.: “NEST-CrowdControl – Advanced Video-based Crowd Monitoring for Large Public Events”. In Proc. of the 11th Future Security Conference., Berlin, Sept. 2015 8 1

OPTRONICS (OPT) Competencies and portfolio The Department of Optronics (OPT) develops methods for experimental and model-based performance evaluation and for optimization of passive and active optronic systems. Laboratory evaluation systems are being developed for infrared detector mosaics, thermal imaging equipment, image intensifier tubes and laser sensors, taking into account perturbation and hard- ening. Theoretical work related to novel evaluation methods and variables have resulted, among other innovations, in new analytical range models and imaging simulation models. Our thermal range model IOSB_TRM4 allows a calculation of the performance of scanning and rigid thermal imaging devices, and cameras in the VIS, NIR, SWIR and thermal IR spectral range. IOSB_TRM4 is continually adapted to current require- ments and equipped with new features: The current version includes a batch mode, which enables the user to incorporate the program in different software and simulation environments for the purpose of e.g. hardware optimization or development. device. The simulation uses high-quality image templates as a substitute for real-life scenes. Using advanced image processing, the templates are degraded to the extent that the resulting image most closely resembles the image that the simulated imaging device would show of the scene. The use of laser sensors is often limited by the safety requirements associated with laser equipment. To estimate the hazard range of the laser sensor, the degree of reflection of the laser radiation from the investigated object must also be known. Both modeling and numerical calculation of the reflection behavior of laser radiation on surfaces that are subject to statistical fluctuations – such as water surfaces – present a particular challenge. For this purpose, the dynamic water surface model IOSB_WOM has been developed and validated during field trials at open waters. Novel sensing methods and components are being developed and implemented in newly build up prototypes. They include gated viewing cameras and laser radars with heterodyne detection for determining 2D and 3D laser reflection signatures, and 2D vibration signatures for target classification over long distances. For image simulation of sensors in static applications, the simulation model SITOS(S) and OSIS have been developed. These can be used to simulate real-life scenes from an imaging To obtain the 2D vibration signature, the laser beam scans the target in X and Y direction. For each measuring point a frequency analysis is performed. If the target vibrates (e.g. a 1 2 8 4 C o r e C o m p e t e n c e O p t r o n i c s

running drive unit) a micro Doppler shift is imprinted onto the laser beam. This allows vibrating targets to be located through partial obstructions (vegetation, fog, camouflage nets, etc.) to analyze their vibration behavior. From the findings, conclusions about the motorization of the objects can be drawn and their geometric shape partially reconstructed. New methods for measuring vibration signatures without a laser were developed applying high speed cameras in different spectral regions. In addition, concepts for the protection from laser radiation are being developed for optronic sensors, with a particular focus on protection against laser dazzling. Projects • Laser radar demonstrators and methods for target classification • Use of laser vibrometry for remote diagnosis of mechanical structures • Analytical calculation, modeling (IOSB_TRM4), and experi- mental verification of the range performance of imaging sensor systems (passive and active) in the spectral range from UV to thermal infrared for military and civilian tasks • Image based evaluation of sensor performance (IOSB_OSIS) within a European effort to establish a common European model (ECOMOS) • Experimental performance evaluation of passive and active optronic sensors including the use of new sensors and concepts with optimized data processing (see illumination depending contrast in image 3) • Eye protection against laser radiation (protection from dazzle and injury) • Influence of and protection from laser radiation on optronic sensors • Propagation phenomena of ultra-short laser pulses (femtoseconds) in atmosphere and in optical materials • Propagation of high energy laser radiation through atmosphere • Investigations on the use of laser radiation in maritime environments using a water surface model IOSB_WOM • Development of laser safety concepts 3 4 Head of department: Dr. rer. nat. Helge Bürsing Phone +49 7243 992-446 helge.buersing@iosb.fraunhofer.de www.iosb.fraunhofer.de/OPT 1 , 2 Gated-viewing exposure of a ship with sliding gate tech- nique in Figure 2 (3D image). 3 eSWIR images with and without illumination showing contrast inversion in the recorded image. 4 Laser vibrometry for wind turbine inspection using a tracking camera (in cooperation with OBJ). C o r e C o m p e t e n c e O p t r o n i c s 8 5

SIGNATORICS (SIG) Expertise and portfolio The work of the SIGNATORICS (SIG) department focuses on the following main areas: • Environmental limitations of EO/IR systems • Warning sensor technology • Signature assessment and management Understanding the interactions between system performance and environmental / atmospheric conditions is a core mission of our research. Thus the characterization of the environment is an essential task. The department essentially deals with sys- tems operating within the ultraviolet to the infrared spectral band. As well as identifying adverse environmental effects, the department also develops methods to overcome or mitigate these limitations. The department develops, assesses and optimizes warning sensors for both military and civil applications. Profound knowledge of threat signatures and backgrounds is a key component of these tasks. Consequently, it is vital to gather information regarding potential threats. Work in the field of signature management focuses on two different aspects. On the one hand, it develops techniques and methods to improve own camouflage and reduce signatures. The objective is to reduce detectability and thus improve survivability and mission success. On the other hand, it researches ways to overcome camouflage, concealment and deception measures by possible opponents. The planning and the conducting of field trials are important aspects of our work. We develop and use ground-, sea- and air-based sensor systems and measurement techniques to do this. We also work with satellite-based sensor systems. Relevant material and system properties are identified with the help of innovative laboratory equipment and related methods. The use and development of numerical simulations completes the department’s portfolio. 1 2 8 6 C o r e C o m p e t e n c e O p t r o n i c s

Competencies of the department: • Innovative warning sensor technology for the military and the civilian sector; • Prototype realization with the use of optical, electronic and mechanical design tools; • Sensor design for satellite-based monitoring systems; • Characterization of environment and atmosphere; • Development of measurement methods and equipment; • Identification of adverse effects and development of corresponding mitigation methods; • Design and realization of innovative adaptive optics systems; • Algorithm engineering for real-time image correction; • Development, testing and evaluation of multi-spectral signature management approaches and deception measures; • Field trials in maritime and terrestrial environments with passive and active, ground- and air-based sensors ; • Identification of optical properties of materials within the full spectral range; • Design and development of analytical models and nume- rical simulations for radiation transport and propagation processes. 4 Head of department: Dr. rer. nat. Karin Stein Phone +49 7243 992-114 karin.stein@iosb.fraunhofer.de www.iosb.fraunhofer.de/SIG 1 Firing of a surface-to-air missile from a tank. 2 Analysis of environmental phenomena. 3 Measurement setup for BRDF determination. 4 Adaptive optics testbed for atmospheric turbulence correction. 3 C o r e C o m p e t e n c e O p t r o n i c s 8 7

LASER TECHNOLOGY (LAS) Being available to the other departments at IOSB, the novel sources developed by LAS enable further research, develop- ment and expertise in Optronics and Photonics applications like performance evaluation of passive and active optronic sensors and protection at IOSB. Projects • 1.6 µm Erbium lasers, e.g. for ranging and gated viewing • 2 µm Thulium and Holmium fiber lasers in continuous wave and pulsed regimes • 2.1 µm solid-state lasers with scaled pulse energy • 3.9 µm Holmium-based fiber lasers • Non-linear converters in the MWIR and LWIR spectral range based on solid-state and fiber non-linear materials • Analytical and numerical modeling and experimental verification of laser dynamics and resonator performance Competencies and portfolio The new Department of Laser Technology (LAS) created in 2018 is devoted to research and development of specific photonic materials and components, related laser sources and non-linear converters for the development and optimi- zation of laser systems in the NIR, SWIR, MWIR and LWIR spectral range, focussing on the specific demands posed by optronic applications. Based on our competences in rare-earth (e.g. Erbium Er3+, Thulium Tm3+, Holmium Ho3+) and transition-metal (Chromium Cr2+) doped laser materials and source architectures, we develop SWIR and MWIR solid-state and fiber lasers and rela- ted components. These lasers can be used as direct emitters in typical applications like communication, illumination and metrology or are optimized for pumping non-linear converters. Experimental activities are in high-power cw and pulsed 2 µm fiber lasers, components and architectures, pulsed 1.6 µm and 2.1 µm high-pulse-energy solid-state lasers and direct-emitting MWIR fiber lasers. Novel components are being developed, implemented and tested in laboratory setups to enable power scaling and adding functionality to new laser systems. They include fiber couplers and spliced components for SWIR and MWIR fibers, novel laser materials and resonator geometries. Based upon our laser sources we investigate non-linear con- verter materials and develop and optimize architectures for MWIR and LWIR sources with specifically adapted properties for optronic applications. Theoretical work is related to modelling of complex laser dynamics and novel resonator schemes for enhanced beam quality operation of high-average-power lasers and non- linear converters. 8 8 C o r e C o m p e t e n c e O p t r o n i c s

VISUAL INSPECTION SYSTEMS (SPR) Competencies and portfolio The Visual Inspection Systems (SPR) department develops and delivers systems for automatic visual inspection tasks in industry. The main areas of application are currently the automatic sorting of bulk goods in recycling, mining and food industry (e.g. waste glass, metals, ores, diamonds, tea, herbs, coffee beans, grains, and seed), the inspection of sur- faces for defects (e.g. paint coat inspection), the inspection and characterization of transparent materials of all various shapes (e.g. flat glass, headlight glass, and sunroofs), color measurement of granulates and inspection of blister packs. The department operates an image exploitation center and a cross-application multi-sensor lab with experimental apparatus for process clarification as well as development systems for a variety of application areas. In the hyperspectral imaging laboratory, materials can be inspected within the wavelength range from ultraviolet (UV) up to and including near infrared (NIR) in order to obtain optimal decision-making criteria for the inspection task. The work group for multispectral data analysis coordinated by SPR has strong experience in the field of hyperspectral imaging. All these applications are characterized by the fact that the inspection is performed at high throughput rates inline with the higher-level process, which thus requires high-performance image exploitation systems. High-resolution line scan cameras of various types (color, grayscale, UV, and imaging NIR), 3D area array sensors or laser scanners are used as imaging sen- sors.The image acquisition equipment is individually tailored to the specific task at hand, making particular use of folded beam paths and LED flash illumination. The system platform for solving application tasks consists of standard PCs based on the PCIexpress bus under the Windows 7 and Windows embedded OS. The system’s high processing power is achieved with specially developed framegrabber for the PCIexpress bus. Together with a real-time system of algorithms for the acquisition and exploitation of images, this platform is at the core of the delivered application systems. Projects and products • VisioChromHR: Image exploitation system for automatic inspection of tablet blisters • Clarity: Image exploitation system for automatic sorting of waste glass shards • ClarityHR: Image exploitation system for automatic sorting of heat-resistant glass • ClarityLead: Image exploitation system for automatic sorting of lead-containing glass • Minexx: Image exploitation system for automatic sorting of minerals • FoodControlHR: High-resolution image exploitation system for automatic purification of tea, herbs and dried vegetables • CoffeeControl: Double-sided image exploitation system for automatic sorting of coffee • WheatControl: Image exploitation system for automatically The department’s products are used in industrial applications around the world. Partnered companies are responsible for marketing and service. In some cases, however, the department develops directly for end users and takes care of installation and service in the process. cleaning grains • GranuControl: Image exploitation system for automatic sorting of plastic granulates • SpotInspect: Image exploitation system for automatically detecting contamination in a material flow 9 0 C o r e C o m p e t e n c e O p t r o n i c s

Head of department: Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 thomas.laengle@iosb.fraunhofer.de www.iosb.fraunhofer.de/SPR 1 Food Inspection. • Purity: Image exploitation system for detecting defects as air bubbles or inclusions in arbitrarily-shaped transparent materials (e.g. flat glass, curved glass, lenses, or granulate) In addition to cameras and lighting equipment, they include: • Sliding stages with a variety of different lighting fixtures for • Purity tension: Image exploitation system for detecting image acquisition defects and measuring tension in arbitrarily-shaped transparent materials • WindShield Inspection: Inline image exploitation system • Experimental systems for sorting bulk goods (each equipped with a camera and blow-off device) in various configurations as a belt sorter, sorter with chute and free-fall sorting for detecting defects in windshields Infrastructure and equipment Image exploitation systems for industrial visual inspection are application-specific or customer-specific. This is why almost all research projects start with the question of whether the respective task can be solved at all using an machine vision system? Subsequently, the limits of the inspection accuracy are determined. Eventually, an estimation of the resource requirement for system realization is performed. Satisfactory answers to these questions can be obtained only through experiments, which tend to be costly and time-consuming. • Measurement stations for inspecting surfaces • Measurement setup for 3D inspection • System for transparent materials • Hyperspectral Imaging Laboratory (240 – 2500 nm) • Lab equipment for material characterization • Sorting container for fast prototype production • Cleanroom for inspecting sensible parts The methods used for image exploitation permit evaluation of shape, texture, color, specular reflection, spectral properties and 3D characteristics of the specimens. 1 The image image analysis center and the cross-application multi-sensor lab of the IOSB were set up for the purpose of experimental procedure clarification with, if applicable, the involvement of other IOSB departments and the and different KIT research groups. The image exploitation center and the multi-sensor lab offer numerous facilities for image acquisition and exploitation. C o r e C o m p e t e n c e O p t r o n i c s 9 1

ENERGY (NRG) Expertise and portfolio The German and European energy supply is facing major challenges: Renewable energy is only one aspect of the current structural changes to the energy system. Energy efficiency and cross-cutting issues such as electric mobility, power analyzes, forecasts, virtual power plants and energy storage are gaining importance through the interconnected european power system. Fraunhofer IOSB-AST, department energy, has in all these areas extensive knowledge which is applied in various projects over fifteen years. In the industrial sector, the software solution EMS-EDM PROPHET® is successfully represented in the energy market by major partners such as Compello GmbH. Here topics such as energy and energy data management are at the forefront. In energy research, more foreward-looking issues like cross- energy-management, energy storages, wind power forecast technologies or the integration of renewable energy into the power grid are explored. The department energy consists of five working groups: Software systems for energy technology and energy business • Project management and consulting • Forecast of renewable energy demand and feed-in • Supply optimization in liberalized markets • Optimization of energy processes • Balancing group and grid utilization management • Software solution EMS-EDM PROPHET® • Implementation of forecasting and optimization methods • Market regulations support (MaBiS, KoV IV) • Open, cross-system IT-Architecture • Scalable, high performance client / server systems 9 4 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Energy systems and components • System engineering and small power generators • Components for efficient energy use • Local energy storage and grid protection elements • Automation devices and safe IT components • Power grid simulation and planning • Smart grids • Grid system management optimization and adaptive grid protection • Grid integration of energy storages and E-Mobility • Safe IT infrastructure of smart grid Energy Business and System Analysis • Liberalized energy markets and business models • Market processes and communication • Smart metering • Energy business analysis • Development of forecasting and optimization methods IT-Cybersecurity for critical infrastructure energy & water • Attack anatomy and attack scenarios • Law of critical infrastructures • IT security management • Standard procedures and guidelines • Employee awareness Tasks and Projects • ADELE ING - Adiabatic compressed-air energy storage (CAES) for electricity supply (BMWi, Energy Storage Funding Initiative) • Smart Region Pellworm – Energy storage integration into a virtual power plant (VPP) • ICT energy lab - research and development platform for analysis and development of IuK technologies for centralized Core and decentralized intelligent energy supply systems and training center for EMS-EDM PROPHET®

Head of department: Prof. Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 peter.bretschneider@iosb-ast.fraunhofer.de www.iosb.fraunhofer.de/AST 1 Research project VEREDELE FACDS - Interdependency ana- lysis of flexible AC distribution grids. 2 Trainings within the Fraunhofer Academy Initiative „Learning lab cyber security“. C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 9 5 • EMS-EDM PROPHET® - energy management with forecast and optimization as well as energy data management for liberalized energy markets • Demand analysis energy storage 2 - The impact of the distributed power generation for electricity generation and evaluation of energy balancing technology (BAES2, BMWi) • EBITA - Exploiting the Scientific and Business Potential when Integrating Smart Data Analytics into Internet of Things applications • REGEES: Renewable electrical energy system – Reg-EESystem - 100 % integration of renewable power in 2030 (BMWi) • VEREDELE FACDS - Robust control and feedback control systems of distribution power grids with a high proportion of fluctuating power production and fl exible loads with the approach of flexible AC distribution systems (BMWi) • DynaGrid Control Center - Extension of conventional transmission power control systems to future-proof, dynamic control rooms (BMWi) • sMobiliTy: COMMERCIAL - Optimization for a predictive, power grid and power-market-driven load management 1 • Feasibility study: Energy efficient industrial zone Erfurt (Industry) • Study EE-GEW; Energy efficient manufacturing business areas - smart building control technologies for commercial real estate for energy-efficient overall energy supply • ZAYED – Capacity for Renewable Energies (ZAYED funding program) • Training center IT-cybersecurity - critical infrastructures / applications for energy and water infrastructures (Fraunhofer academy / BMWi) • Scientific accompanying research in the research field "Energy in buildings and neighborhoods" - Subprojects: Scientific accompanying research in the fields of power grid and decentralized energy systems (BMWi) 2

WATER AND MOBILE SYSTEMS (WMS) Expertise and portfolio The department water and mobile systems is engaged in the field of holistic and integrated consideration of water supply systems, the development of embedded systems, assistance systems, and autonomously driven land and underwater vehicles. The department is split into three working groups: • Modeling, simulation and optimization of surface water systems • Flash flood warning systems • Water demand forecast Embedded systems • Integration of embedded systems • Embedded control and regulation systems • System design and modules for autonomous vehicles • Hardware integration • Guiding systems for vehicles • Maintenance and diagnostic systems • Sensor data fusion and simulation Water supply and wastewater treatment • Drinking water abstraction • Drinking water treatment • Drinking water distribution • Reservoir and dam systems • Wastewater collection • Wastewater treatment • Sludge treatment • Recycling of wastewater Maritime systems and surface water • Simulation and guiding software for underwater vehicles • Design, engineering and construction of underwater Tasks and Projects • Otto Bock Mobility Solutions GmbH: remote data logger • DAIMLER AG: Temperature transmission and CAN module temperature • Stadtwerke Marburg: HydroDyn industry project water distribution • HAPPI: small hydro power plant – evaluation of the poten- tial of climate protection and improvement by intelligent technology • MoMo III: Integrated Water Resources Management for Central Asia: Model Region Mongolia Phase 3 • ABB Projects: Abu Dhabi, Mina Abdullah, Hafar al Batin, New Cairo Taif Baha, Ras Alzaur Pipeline System • INAPRO - Innovative model & demonstration based water management for resource efficiency in integrated multitrophic aquaculture and horticulture systems Core Competence System Technologies 91 • MoSiOp - Model Based Simulation and optimization of a UV-LED based emitter module • UV-LED AnPHOS - Monitoring and control concept and conversion into control electronics for high-performance UV-LEDs • Fraunhofer 4D: DeDAvE: Deep Diving autonomous under- vehicles and compression-proof modules water vehicle for exploration • Virtual test environment for simulation of mobile systems • iDeWaS - CLIENT II: International partnerships for sustai- and evaluation of vehicle guidance strategies • Control functions for the automated inspection of under- water infrastructure, sea cables and pipelines nable Innovation - Definition project: smart decentralized water systems 9 6 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s

• ReStMuLa UV - Control algorithms and control electronics for multi-lambda UV lighting units with low power consumption • DeOWa – Design and optimization of scalable UV-LED water disinfection reactors • AKIT - Autonomy kit for close-to-production construction machinery for connected and assisted rescue of hazards • SYTECH: Fish farming, FAMSUN • Bischoff Elektronik GmbH: Adapter assembly and test program for final circuit board tests • Neways Technolgie GmbH: Evaluation and optimization of a firmware for charging cables • Atlas Elektronik: AUV-Flare catch control • C-Watch follow up projects in China: ROV-BWSTI, ROV-CAU • Kraken: DEDAVE AUV was sold to Kraken Sonar Inc. (Canada), long-time R&D-License agreement with Kraken Sonar Inc. 1 2 Head of department: Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 thomas.rauschenbach@iosb-ast.fraunhofer.de www.iosb.fraunhofer.de/AST 1 Underwater vehicle based on the C-Watch platform for a chinese customer. 2 Technology platform for autonomous robot vehicles: QUANJO TDS. C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 9 7

100

INFORMATION MANAGEMENT AND PRODUCTION CONTROL (ILT) The objective of the department Information Management and Production Control (ILT) is to develop components and complete solutions for the design, operation and maintenance of complex information, control and test systems. Security requirements are analyzed according to customers’ needs and considered by design. Our focus lies on the following application domains of the Internet of Things (IoT): industrial production, environment, health, risk management, resource efficiency and security. On the basis of agile methods in requirements analysis, system design and recognized architectural and commu- nication standards, we implement open, innovative, and customized software solutions, encompassing and driving new paradigms of the “(Industrial) Internet of Things” as well as “Industrie 4.0”. In order to accompany and support our customers on this way, we offer dedicated consultancy and training services, e.g. enterprise-specific Industrie 4.0 roadmaps, use of standard technologies, the transformation of Manufacturing Execution Systems (MES) to the require- ments and technologies of connected smart factories. action, e.g. for early warning systems of natural hazards. For the Industrial Internet of Things (IIoT) we design and implement smart solutions for the efficient search and processing of heterogeneous data sets (“big data”), the extraction of knowledge with data mining methods (incl. semantic annotation) and the fusion of heterogeneous sensor data to meaningful technical information for decision support (“Fusion4Decision”). We develop and use innovative methodologies for the systematic analysis of user and system requirements including IT security, and design problem- specific service-oriented and event-driven architectures. We develop thematic applications and connect them to integrated environmental information systems. We are responsible for the reference use case in production in the Industrial Data Space initiative. Our software framework WaterFrame® renders data sources accessible and integrates geographical information system (GIS) components as well as innovative geostatistical methods. WaterFrame® supports the generation of thematic maps, diagrams and reports. We analyze the suitability of modeling and communication methods and IT security technologies for: • complex manufacturing processes driven by Industrie 4.0 value chains (e.g. plug-and-work based upon AutomationML and OPC UA) • environmental sensors and observations (geospatial standards of the Open Geospatial Consortium OGC such as the SensorThings API) Our information management system “WebGenesis®” supports ontology-driven Web-based information systems, problem-specific data analysis and personalized user inter- With the ProVis suite we realize production control system components and integrated solutions according to both the classical functional MES requirements, and the emerging IIoT / Industrie 4.0 paradigms encompassing demanding IT security features such as intrusion detection services and secure communication. The functions offered by ProVis range from monitoring and managing production facilities up to engineering control rooms and the processes of manufacturing control. This allows us to deploy production control systems in automotive production sites and the steel industry, including Web-based 9 8 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s

101

Head of department: Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 thomas.uslaender@iosb.fraunhofer.de www.iosb.fraunhofer.de/ILT data analytics and reporting systems. We run vulnerability tests for production systems and critical infrastructures, and develop test systems for selected standards such as Foundation Fieldbus, AutomationML, and HLA. Our technologies are integrated into the IT Security Lab for Industrial Production of IOSB. Our objective is to provide train- ing for new technologies, promote the adoption of standards in the market and to support interoperability in open systems. We therefore actively participate in the Standardization Council Industrie 4.0 (SCI4.0) and other relevant standardization bodies such as VDI/VDE, DKE, DIN, IEC, IIC, W3C and OGC. Products • WebGenesis® – Web-based information and knowledge Infrastructure • ProVis – integration and test facility Dipl.-Inform. Gerhard Sutschet Phone +49 721 6091-370 gerhard.sutschet@iosb.fraunhofer.de • Industrie 4.0 Model Factory and AutomationML test center Dr. Ljiljana Stojanovic Phone +49 721 6091-287 ljiljana.stojanovic@iosb.fraunhofer.de • IT Security Lab Dr.-Ing. Christian Haas Phone +49 721 6091-605 christian.haas@iosb.fraunhofer.de • Smart Factory Web – IIC testbed enabling marketplaces and management solutions for applications in the environment, traffic and automation sectors and for the documentation of research projects • WaterFrame® – Java framework for the development of the- interconnectivity of smart factories Dr. Kym Watson Phone +49 721 6091-486 kym.watson@iosb.fraunhofer.de matic applications and environmental information systems • WaterFrame®– integration and test facility • SensorThings API – open source implementation of the light- weight OGC standard to manage sensors and sensor data • ProVis.Agent®/Visu® – agent-based production control and visualization system for managing and monitoring automated production facilities • ProVis.Paula – production and plant data evaluation system with data mining components • OPC UA/AutomationML Toolset – User assistance ranging from graphical modelling, conversion support to plug-and- work-functionality • AutomationML test system – Web-based conformance testing of AutomationML descriptions, available online at http://amltest.iosb.fraunhofer.de • SERVUS – Web-based requirements engineering tool for service-oriented analysis and design • Network Calculus – methodology for the performance evaluation of communication networks • IsuTest – Industrial Security Testing Framework, open source vulnerability and robustness testing framework Dipl.-Ing. Jörg Stumpp Phone +49 721 6091-259 joerg.stumpp@iosb.fraunhofer.de • Environmental Sensor Network INSENSUM Dr.-Ing. Siegbert Kunz Phone +49 721 6091-600 siegbert.kunz@iosb.fraunhofer.de • Fieldbus Foundation conformance test center Dipl.-Ing. Michael Theis Phone +49 721 6091-321 michael.theis@iosb.fraunhofer.de • HLA simulation test center Dipl.-Inform. Reinhard Herzog Phone +49-721-6091-294 reinhard.herzog@iosb.fraunhofer.de C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 9 9

102

MACHINE INTELLIGENCE (MIT) Competencies and portfolio The Machine Intelligence (MIT) division at Fraunhofer IOSB-INA applies machine intelligence to production and automation solutions. It focuses on the preparation and analysis of production-relevant data using techniques from the areas of big data and machine learning, the use of knowledge-based models for diagnostics and optimization as well as assistance systems to facilitate interaction and collaboration, e.g. in assembly systems. The Machine Intelligence (MIT) division at Fraunhofer IOSB- INA researches and develops industrially viable solutions which enable people to master and control the complex production environments of both today and the future. This includes standardized data management from collection to analysis and application, the use of machine learning tech- niques to harvest valuable information from large volumes of data, the development of algorithms for diagnostics and optimization, and assistance systems which are the interface to human operators. The aim is to enhance the quality of the support provided to the user by the automation, i.e. making it more intelligent. It is in this context that the group Big Data Platforms addresses the challenges of standardized data collection and management. In the first stage of Industry 4.0, communica- tion aims to standardize the collection of data in production environment and enrich it with metadata and contextual information. As in the area of cybersecurity, Industry 4.0 communication is a multifaceted topic which affects every aspect of the value chain. The aim is to enable systems used by different manufacturers and sectors to work together and to create a framework for handling large volumes of data. Here, big data platforms function as a standard platform for storing and evaluating data. 1 0 0 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Topics | Research areas: • Big data infrastructures (parallel and distributed systems) • Interoperability frameworks (e.g. OPC UA) Based on these Big Data platforms, the Machine Learning group is dedicated to developing processes and algorithms which analyze data for applications such as condition monitoring, predictive maintenance, diagnostics and optimi- zation. This involves structuring large volumes of data and mapping them in computer-aided models and simulations. These models can then be used to formulate predictions about the behaviors of real processes, ensure the integrity of systems or forecast equipment condition and maintenance requirements. These cognitive assistance systems always aim to reduce the complexity of the large volumes of data generated by production environments and make them more manageable and meaningful for the user. Topics | Research areas: • Machine learning • Model-based design methods • Optimization methods • Knowledge-based system diagnostics The Assistance Systems group in the Machine Intelligence division researches and develops physical assistance systems which act as the direct user interface in the value chain for industrial automation and process digitization. The production data processed for evaluation and application at the end of the value chain now flow into technical solutions which make working and interacting with automated systems in industrial environments more ergonomic, secure and flexible.

103

These assistance systems are not only used in the operation, maintenance and repair of machinery and equipment but also in providing digital support for manual manufacturing and assembly processes. Topics | Research areas: • User experience studies • Usability tests • Information and interaction design • Development of UI prototypes • Process development and support 1 2 Head of department: Prof. Dr. rer. nat. Oliver Niggemann Phone +49 5261 94290-42 oliver.niggemann@iosb-ina.fraunhofer.de www.iosb-ina.fraunhofer.de 1 Machine Learning: algorithms tapping into the knowledge hidden in Big Data. 2 Remote support: decentra- lised operation and supervision of assistance systems. C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 1 0 1

104

DIGITAL INFRASTRUCTURE (DIS) Competencies and portfolio The Digital Infrastructure (DIS) division at Fraunhofer IOSB-INA researches and develops technical solutions and environments for the industrial automation and applications which is situated at the heart of Industry 4.0. Research and development are focussing on technologies for recording physical measurements using intelligent sensors, the construction of reliable networks based on communication systems and internet technologies with real-time capabilities, and cybersecurity solutions. From smart sensor systems in machinery and equipment to real-time data processing and the construction of software-controlled networks with flexible and integrative protocols, DIS is engaged in building the foundations and developing the architecture for the “Internet of Things” in the context of industrial production. The Digital Infrastructure (DIS) division at Fraunhofer IOSB-INA researches and develops technical solutions for Industry 4.0 applications in the integrated factory environments of the future. The aim is to provide the right quality of information wherever and whenever it is needed so that people, products and machines can interact efficiently. The Industrial Internet / IoT group within the DIS division researches and develops network solutions for structuring and transferring information in real-time. Flexibility, inter- operability, speed and intelligent network controls are at the core of the network architectures which are the foundation of the industrial Internet. Topics | Research areas: • Industrial Internet / IoT • Real-time Ethernet, industrial wireless and real-time middleware • Network management • Solutions for system integration Securing networked technical systems against cyber-attacks and eliminating security loopholes is a multifaceted topic being researched by the Institute’s specialists in industrial automation. The Institute is developing courses and qualifi- cations in cybersecurity in partnership with the Ostwestfalen- Lippe University of Applied Sciences. These are particularly appropriate for small and medium sized enterprises and form part of the range of qualifications offered by the Fraunhofer Academy. To provide context-sensitive situation analysis, computer sys- tems must be able to monitor the physical-technical system using sensor and localization systems. Topics | Research areas: • Hard- and software development for securing critical infrastructures in industrial environments • Training courses offered by the Cybersecurity Training Lab Topics | Research areas: • Smart sensor systems • Indoor localization • Object recognition 1 0 2 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s

105

Head of department: Prof. Dr.-Ing. Jürgen Jasperneite Phone +49 5261 94290-22 juergen.jasperneite@iosb-ina.fraunhofer.de www.iosb-ina.fraunhofer.de 1 Security and real-time capability: basis for connecting the office with the shop floor for IoT applications. 1 Plug and Produce: Flexible and modular production to support high product variability. 1 2 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 1 0 3

106

SYSTEMS FOR MEASUREMENT, CONTROL AND DIAGNOSIS (MRD) Competencies and portfolio • Data analysis for technical processes The acquisition and evaluation of sensory and other data plays a crucial role in many applications: in industry, sensory data, together with process models, establishes the basis for obtain- ing high-quality, universal functionality of products as well as facilitating an optimal productivity of production facilities. A full understanding of the processing chain – from data acquisition through processing and evaluation to optimization or feedback into the process, and always considering the dynamics and other characteristics of the process – is essential also for other fields of application, such as environment processes, robotics, automotive and civil security. In this context the department Systems of Measurement, control and Diagnosis (MRD) offers the following core competencies: - Performance and condition monitoring solutions for complex industrial production processes - Development, adaptation and application of methods for classification, machine learning, and data mining - Machine learning methods for diagnosis and causality analysis in technical systems • Information fusion - Multisensor fusion e.g. for robotic and automotive applications - Dynamic information fusion using heterogeneous sources (e.g. for environmental warning modules) - Fusion of image and geometry data for automotive, robotic and surface inspection applications • Image and signal processing - Real-time image and signal processing - Defect detection on surfaces using adapted classification • Modeling and simulation methods - Analytical, knowledge-based and data-driven modeling - Machine learning methods for modeling complex technical processes - Modeling, simulation and synthesis for sensor systems - Block-oriented and finite element models - Simulation for virtual test drives of road vehicles (OCTANE) - Driver modeling using deep learning • Measurement and sensor techniques - Advanced deflectometry methods for surface inspection - Image-based surface inspection techniques - Optical and imaging measurement concepts - Automated microscopy • Control and feedback control techniques - Model predictive and structure-variable control concepts in process engineering and robotics - Process control using machine learning methods - Generation of 3D data (e.g. using deflectometry, sidescan sonars, stereo cameras and other reconstruction methods) - 3D data and image processing for applications in robotics, automotive and surface inspection - Visual navigation for autonomously driving road vehicles - Content-based image retrieval in very large databases with machine learning concepts • Robotics - Safe physical human-robot interaction - Environment-interactive path and trajectory planning - Simultaneous localization and mapping (SLAM) - Advanced techniques for localization and mapping - Control of complex robotic kinematics - Robot control based on ROS middleware - Algorithm toolbox for autonomous mobile robots 1 0 4 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s

107

Head of department: Dipl.-Ing. Christian Frey Phone +49 721 6091-332 christian.frey@iosb.fraunhofer.de www.iosb.fraunhofer.de/MRD 1 Robot systems for deconta- mination in hazardous environ- ments. Applications and projects • Monitoring, control and optimization in process engineering - Model-based control in process engineering - Tools for online condition monitoring in chemical and - Usability studies for driver assistance systems - Solutions for estimation of weather und road surface conditions pharmaceutical industry - Concepts for machine perception under adverse weather • Quality and productivity assurance for process and conditions manufacturing engineering - Intuitive operator tools for process optimization - Machine learning based tools for evaluating process and product data - Surface inspection systems for painted, specular and - Fog density estimation using intelligent structured spotlights - Aerial video analysis for building statistical models of the behavior of traffic participants textured surfaces • Sensor systems - Image-based sensor systems for online surface inspection - Sensor systems for underwater robotic applications - Automated microscopic inspection - Automated real-time detection of toxic contaminations • Robot applications - Solutions for autonomous service and inspection robots - Robotic applications in logistics and for security applications - Precision farming and construction operations • Security and environment - Quality control for water supply systems and waste water 1 disposal - Energy monitoring and optimization for home applications - Security concepts for drinking water supply - Robot-based exploration and mine clearance in former conflict areas • Automotive applications - Visual navigation for autonomously driving road vehicles - Concepts for building groups and alliances for cooperative driving - Pedestrian detection in low resolution images - Cyber security benchmarks for Car2Car communication C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 1 0 5

110

INTERACTIVE ANALYSIS AND DIAGNOSIS (IAD) Profile and competencies The department Interactive Analysis and Diagnosis (IAD) develops smart interactive environments and assistance sys- tems to support people in various analysis and decision tasks. These systems usually need to process large amounts of data, especially data of individual persons. To protect users from the inappropriate use of their personal data, technologies for privacy and security by design are investigated. Smart environments, such as attentive and innovative production environments, and assistive operating rooms or intelligent car interiors need innovative concepts for human machine interaction. The focus lies mainly on techniques using camera- and video-based interaction methods, such as detecting and tracking persons, recognizing hand poses and pointing gestures, as well as analyzing activities and supporting gaze-based interactions but also applying speech recognition systems. Assistance systems support people in the process of decision-making. Application areas are image interpretation, intelligent surveillance systems, manual assembly in produc- tion and medical diagnosis. Methods in the area of artificial intelligence, e.g., machine learning and data mining, extract relevant information from large quantities of data. Man- machine-interaction techniques enable us to develop user interfaces with a high usability. Therefore, human experts get the best support to make final decisions. Our concepts take into account the strengths of both com- puter systems and humans. Computer systems are capable of rapidly saving, searching and calculating large quantities of data. Humans, on the other hand, are still superior to computers when it comes to recognizing and interpreting complex structures in a high amount of data. 1 0 8 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n Accessing and processing personal identifiable information (PII) helps us to build attentive environments that react to human needs. Legal regulation, such as the European general data protection regulation (GDPR), demand a high level of IT security and privacy protection whenever PII is processed. IAD employs a group of IT security professionals, who develop their privacy expertise in research projects and consult industry partners on how to incorporate privacy by design into their systems. Following solutions are currently provided: Multimodal Human-Machine-Interaction • Camera-based face, head and body pose estimation, hand and pointing gesture-recognition for intuitive human- machine interfaces • Multimodal and natural Human-Machine-Interaction within multi-display environments • Gaze-based interaction for video image analysis • Multi-person tracking and face identification for presence- aware and personalized, adaptive HMI solution • Interaction techniques for mobile augmented reality applications • Industrial HMI, e.g. gesture based quality assurance and defect documentation Assistance systems • Situation recognition and anomaly detection for crisis management and security services • Medical expert systems • Intelligent workflow-analysis • Decision support systems • Knowledge discovery in large data bases IT security and Privacy by Design • Privacy by Design for interactive systems

111

Head of department: Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 721 6091-393 elisabeth.peinsipp-byma@iosb.fraunhofer.de www.iosb.fraunhofer.de/IAD 1 Video-based passenger recognition for personalized assistance systems. 2 Digital Map Table for team- oriented analysis of geographi- cal information. C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 0 9 • Privacy-aware smart video surveillance • Data portability and data usage transparency • User-Managed access for PII The following products and projects are provided: • Digital Map Table – A multi-display workspace for computer-supported situation analysis • InCarIn – Recognizing the car interior’s passengers for intuitive, activity-aware and adaptive infotainment and comfort assistance functions • PAKoS – Adaptive semi-autonomous driving by means of recognizing the activities and distractions of driver and passengers • RecceMan® – Interactive assistant for identification of objects and infrastructure • WiMAAS – Data Fusion in maritime wide area surveillance applications • MARISA – Maritime situation assessment and anomaly detection for supporting situation awareness of decision makers • FastPass – Optimizing the waiting time at border control stations • KonsensOP – A context-based assistance for a medical team in an operating room • OnkoLeit – A medical expert system following clinical practical guidelines for diagnosis, treatment and follow-up of oncological diseases • ArGUS – Assistance system for countermeasures in UAV-attacks • KASTEL – Competence center for applied IT security • SecureAutoType – Secure and user-friendly password management • ASARob – An awareness sensitive robot for intuitive human-robot interaction • S2UCRE – Advanced video-based crowd monitoring and decision support for large public events 1 2

112

INTEROPERABILITY AND ASSISTANCE SYSTEMS (IAS) Competencies and portfolio The department Interoperability and Assistance Systems (IAS) offers solutions to the market in which the interaction of people with complex information systems plays the key role. In a “system of systems” approach interoperability is vital. With research and development projects in the field of soft- ware architecture for computer-based assistance systems with a focus on dialog design and semantic interoperability, we contribute to the technical and content networking of systems. By designing dialogs that are adapted to the users and tasks we promote collaborative work using innovative multi-modal and multi-media interaction technologies. With ontology-based information systems, web services and intel- ligent software agents the knowledge needed is distributed on time to the right people through suitable connections to personalized end-user devices in a layer-compliant granularity. Modern, technology-based learning environments and the use of “serious games” provide users with the required decision-making abilities. Providers of knowledge-intensive services will be supported in focusing on their core compe- tencies and creativity. The work includes the design, implementation and evaluation of system solutions for interactive sensor data analysis, knowledge creation and integration of knowledge into expert systems to support networked data analysis, the modeling of users, workflows and application domains, as well as compe- tence management in distributed systems. Laboratory and field experiments on demonstrators and operational systems are performed to optimize system performance and to evaluate human-machine communication. In addition to developing basic system architectures that promote interoperability the department’s product range includes components for interactive image analysis, ontology-based specialist databases, network- enabled information management systems, and training and education systems. Compliance with and monitoring of national and international software quality standards is an integral part of the development activities. Our partners and clients include the German Federal Ministry of Defense (FMOD), Federal Office for equipment, information technology and use of the Armed Forces (BAAINBw), the defense industry and the European Union. In various international cooperations experience in the field of image- based reconnaissance and surveillance is exchanged. In our research we cooperate with universities, colleges and partner institutions. Applications are mainly in the fields of defense and civil security. 1 1 0 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n

113

Head of department: Dr.-Ing. Rainer Schönbein Phone +49 721 6091-248 rainer.schoenbein@iosb.fraunhofer.de www.iosb.fraunhofer.de/IAS 1 Interoperability. Projects and products Equipment • Image database – archiving system for the management • ISVA demonstrator – a hub for national and international secured networks in the field of reconnaissance and surveillance • SaLVe – radar image database center: a multi-sensor image data archive for remote sensing • AMFIS – reconnaissance and surveillance with miniature aircrafts in the sensor network (configurable ground control stations, various UAVs, UGVs and sensors) • A mobile ad-hoc sensor network (GPS, imaging and acoustic, 1 vibration, temperature, motion and light sensors) • MAJIIC – demonstration laboratory (restricted area): Multi- sensor Aerospace-Ground Joint ISR Interoperability Coalition • DNBL – development laboratory (restricted area): Distributed Network Battlelab Laboratory for certification and testing of components for networked intelligence gathering and reconnaissance 1 of aerial and satellite images • Image data management system for aerial and satellite image analysis in the field of reconnaissance and surveillance • SAR Tutor – web-based training tool for SAR image analysis • Crayons© – web-based authoring and learning environment • ViSAR – simulator for visualizing geometric radar effects • CSD/NSD Coalition/National Shared Database. Client-server system for distributing reconnaissance-relevant information (requests, orders, messages, sensor data and products) in accordance with STANAG 4559 • ISAAC (ISr Artifact Access Client) Software Suite (.lib, .bat, desk, .map, .web) for accessing CSD/NSD servers according to STANAG 4559 (NSILI – NATO Standard ISR Library Interface) • ISVA – intelligent reconnaissance sensor combination for networking data, information, services and experts • I2Exrep – database-supported form-based report generation for analysis of aerial and satellite images according to STANAG 3377/3596 and other reporting formats • DbEd – Data Tree Editor for creation and maintenance of the reporting vocabulary used in image based reconnaissance • MAJIIC 2 – Multi-INT All-source Joint ISR Interoperability Coalition • AMFIS ground control station – Generic ground control station. AMFIS (reconnaissance and surveillance with miniature aircraft in sensor networks) for controlling and coordinating stationary and mobile sensors/sensor carriers, and for evaluating sensor data and situation reports C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 1 1

114

OBJECT RECOGNITION (OBJ) Expertise and portfolio The department Object Recognition (Objekterkennung - OBJ) develops and evaluates algorithms for automatic object detection and object tracking in sensor networks. The department’s activities range from the evaluation of video streams in the infrared and visual spectral band and the analysis of laser sensor data to the semantic description of a three-dimensional, dynamic environment via multi-sensory data acquisition and automatic alerting in case of specifically defined occurrences. In addition, real-time implementations of the algorithms are evaluated on the basis of heterogeneous hardware structures. The research work in the field of Object Recognition in Sen- sor Networks is focused on the detection and representation of objects in imagery data streams of interconnected mobile sensors. In this context the technologies investigated include aspect-independent descriptions of objects, the registration of sensor-generated images with three-dimensional context data, and bandwidth-economical transfer of object information. Video Content Analysis combines methods for the detection and tracking of objects in video streams with algorithms for the conceptual description and analysis of the extracted quantitative information. The studies aim at devising systems for the semantic analysis of videos. This means that videos are not only analyzed quantitatively, but that the extracted information is associated with conceptual background know- ledge in order to draw conclusions from the visually perceived environment. Machine vision algorithms extend from simple filtering func- tions up to complex analysis methods. Currently available hardware also varies with respect to computing performance, programming paradigms, architectures, and power consump- 1 1 2 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n tion. The field of Heterogeneous Hardware Structures deals with the specification and combination of hardware structures suitable for complex real-time vision systems. Especially with regard to military tracking systems, performance evaluation is an essential topic. Based on years of experience the field Tracking and Tracker Assessment deals with the development and design of evaluation schemes that interrelate and evaluate both the performance ability of tracking algo- rithms and the risk analysis, while possible counter-measures are taken into account. The acquisition and analysis of 3D data is of increasing importance in those application areas that require a high degree of automation and reliability of object recognition. The department’s work in the field of Object Recognition in 3D Data is concerned with the development, optimization, and evaluation of methods for 3D data analysis for use with established sensor techniques as well as prototypical hardware. In addition to object recognition, data acquired by theses sen- sors is used for detecting changes and for providing context information for image exploitation. Selected Projects • THS® - Target Handoff System • Semantic Video Analysis • MODISSA – Mobile Distributed Situation Awareness • Change Detection in Lidar sensor data • VibroTrack – distant vibration measurement on running wind turbines

115

Head of department: Dr. rer. nat. Michael Arens Phone +49 7243 992-147 michael.arens@iosb.fraunhofer.de www.iosb.fraunhofer.de/OBJ 1 Trajectory estimation of a 2 The project Semantic Video moving camera based solely on Analysis aims at detecting, clas- visual information. Top: camera sifying, and conceptually describ- view together with overlayed ing events and interrelations of visual features tracked in 3D events in visually perceivable during the process. Bottom: scenarios. birds eye view on the estimated trajectory of the camera (blue), the ground truth path (red), and 3D features of the surrounding (green). 1 2 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 1 3

116

SCENE ANALYSIS (SZA) Competencies and portfolio Background of the department’s research activities is the demand of intelligence and reconnaissance for the prompt availability of interpretation results with georeference. This includes both wide-ranging evaluation (screening) and local 3D scene reconstruction, required as a basis for decision making in the context of military operations and disaster management. A multitude of powerful airborne and spaceborne systems, e.g., Heron, SAR-Lupe and TerraSAR-X, delivers data that can no longer be evaluated by humans due to its sheer volume and the resulting work load. Automatic conditioning and processing of the data draws the interpreters attention to relevant sections, thereby also enabling the efficient process- ing of large data volumes. For a fast and precise evaluation, the interpreter needs assistance systems that are able to detect, analyze and classify objects and scene changes. The Scene Analysis department develops and studies methods for the automatic evaluation of multi-sensor image data in reconnaissance networks. For this purpose efficient procedures are being developed for segmentation, classification, scene reconstruction, change detection, and fusion of a wide range of sensor data. The research focuses on • Image interpretation • 3D object analysis • Cooperative data evaluation in sensor systems • Exploitation of Synthetic Aperture Radar (SAR) images In the scope of image interpretation the analysis of hyper- spectral data is of particular importance. Here, methods for the extraction of relevant information take center stage. Applications range from the pure reduction of data for a better utilization of transmission bandwidths to the generation of indications in both single and multiple images (change detection and change categorization). The common 1 1 4 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n exploitation of data from a multi-sensor platform (VIS, LWIR, Hyperspectral and LIDAR) is one of the key features of actual demonstrators or future operational systems. Data fusion and information extraction are the core competencies for a successful exploitation and are therefore one of the depart- ment’s main research activities. Often a scene can be evaluated properly only if its spatial extent can be determined. Therefore, the Scene Analysis department develops procedures for the automatic derivation of 3D descriptions of urban terrain based on the evaluation of multi-sensory image data acquired by spaceborne, airborne, or land-based reconnaissance systems. To utilize the efficiency of networked sensor systems, the method of interconnected sensor data evaluation must be designed based on the “system of systems” concept. For this purpose, procedures are being developed which relate the data of imaging sensors to a common reference frame. The potential applications from the fusion of sensor data up to a real-time-generated overview of situations are being analyzed and adequate procedures realized. Only few sensors can acquire evaluable image data, irrespec- tively of the daytime or current weather conditions. The per- formance of imaging radar systems, with a synthetic aperture (SAR) is hardly limited in this regard. Because of their phase- preserving evaluation, interferometric SAR systems are able to capture the 3D shape of a scene. Furthermore, by using time series, very small surface movements can be detected. SAR images are difficult to interpret by a human due to the specific mapping characteristics. Therefore, interpretation support is particularly valuable. SAR image analysis and simulation are therefore among the core competencies of the department, with a special focus on feature analysis, change detection and change categorization in SAR images.

117

Research work focuses on the following core topics: Image interpretation • Efficient screening procedures for the analysis of large data volumes • Structural change detection • Analysis of hyperspectral image data • Fusion and exploitation of data from multi-sensor systems 1 3D object analysis • reconstruction of 3D objects from image sequences or laser scanner data • Automatic derivation of 3D building models from 3D point clouds Cooperative data evaluation for networked sensor systems • Information fusion of sensor data and geo-information • Automatic georeferencing of image contents • Preparation of sensor data showing urban terrain for simulation systems SAR image exploitation • Feature extraction and analysis, change detection and 2 1 categorization • Simulation of SAR image signatures for interpretation assis- tance (CohRaSS: Coherent Raytracing-based SAR Simulator) • Determination of ground heaving or depression by means of time series • Model-based building reconstruction from interferometric SAR images Head of department: Dr.-Ing. Karsten Schulz Phone +49 7243 992-106 karsten.schulz@iosb.fraunhofer.de www.iosb.fraunhofer.de/SZA 1 Road extraction from aerial images with a segment based random forest classification using feature selection. 2 View on an automatically extracted model of the scene “Vaihingen“ with buildings, vegetation and terrain. C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 1 5

118

VIDEO EXPLOITATION SYSTEMS (VID) Competences and portfolio The department Video Exploitation Systems (VID) researches and develops video exploitation algorithms and systems for airborne, land-based and maritime sensors-systems. One core competence is the development of video exploitation systems incorporating geospatial data for unmanned aerial vehicles (UAVs)/drones and surveillance cameras. Our systems improve situational awareness, which play a vital part in the fields of disaster management, forensics, video security systems, homeland security, and defense against terrorism. The complexity and demands for robustness, reliability, and efficiency of the computed results are steadily increasing. The department VID is active in the fields of automatic pro- cessing and exploitation of image signals in complex, mainly non-cooperative surroundings. The image data comes mainly from image acquisition sensors in multi-modal platforms (space, air, land, or water). VID develops and integrates soft- ware for image processing, object classification, and fusion. Therefore, we do research on state of the art computer vision algorithms optimized for specific scenarios, including aspects like neural networks (deep learning), GPU-/multi-core processing for high performance and embedded systems. The main research areas comprise: • Machine learning (esp. deep learning, convolutional neural networks) • Super resolution • Change detection • Image optimization • Multiple target detection, tracking, and classification • Trajectory / track classification • Behavior analysis • Geo-registration / mapping • High performance computing. 1 1 6 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n The main sensors taken into account are visual-optical, infrared, and in some cases also others (SAR, SWIR, UV, …) A major aspect of our work is the realization of components (commonly in form of binary libraries) to be integrated into larger systems. We also realize and deploy whole (software) systems based on our state of the art software production system. Further areas of expertise of the department include interoperability in heterogeneous networks and application of domain knowledge. The performance profile of the developed software is measured by benchmarking and with test systems. Exploitation of airborne imagery from UAVs/drones is our main activity. Further activities include the development of components for moving sensor platforms, C-UAS (Counter Unmanned Aerial Systems), video security applications and marine image exploitation. Tasks and projects • ABUL – Video exploitation system for aerial, land, or maritime based platforms: - LUNA (German Bundeswehr, EMT) - LUNA NG (Next Generation) - ADS-95 RANGER (armasuisse) - IMINT Training Center: Full Motion Video training (German Bundeswehr, AZAALw) - Video exploitation (NATO, Airbus) - SuViMar Maritime video exploitation (WTD 71) - ABUL for avionics-systems – Video functions for pilots in the cockpit • VABUL – Video Database ABUL – Database for change detection, surveillance, and reconnaissance purposes • MODEAS – Modulares Drohnen Erfassungs- und Assistenz System / C-UAV System - Parts of the detection algorithm in visual-optical image streams

119

Head of department: Dr.-Ing. Markus Müller Phone +49 721 6091-250 markus.mueller@iosb.fraunhofer.de www.iosb.fraunhofer.de/VID 1 Software system ABUL for UAV (unmanned aerial vehicles) based reconnaissance and sur- veillance. 2 Software system ivisX for fo- rensic investigations. C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 1 7 - Tracking of detection hypothesizes - Classification of tracks - Classification of drone signatures • NEST – CrowdControl – Video-based crowd density estimation for security / large events • ivisX – An Integrated Video Investigation Suite for Forensic Applications • Federal Ministry of Education and Research (BMBF) - MUSKAT – Multisensoriell gestützte Erfassung von Straf- tätern in Menschenmengen bei komplexen Einsatzlagen - S²UCRE – Sicherheit in städtischen Umgebungen: Crowd- Monitoring, Prädiktion und Entscheidungsunterstützung - FLORIDA: Flexibles, teilautomatisiertes Analysesystem zur Auswertung von Videomassendaten • European Union (EU) - MobilePass – Algorithms for touchless fingerprint and face verification with mobile devices for border control - Tulipp – Towards Ubiquitous Low-power Image Processing Platforms - VICTORIA – Video analysis for Investigation of Criminal and TerrORIst Activities • DetAktiv – Detection and tracking of moving objects in UAV video data 1 2

120

VARIABLE IMAGE ACQUISITION AND PROCESSING (VBV) RESEARCH GROUP Competencies and Research Topics The Variable Image Acquisition and Processing (VBV) Research Group develops methods and systems for automated visual inspection that are based on variable image acquisition tech- niques, or, more generally, exploit various kinds of heteroge- neous information. Multiple theoretical and application-related issues studied here in close cooperation with the other departments of the IOSB and the Vision and Fusion Laboratory (Lehrstuhl für Interaktive Echtzeitsysteme – IES) of the Karlsruhe Institute of Technology (KIT) include: • Holistic systems theory-based modeling of image acquisition and optimization of the evaluation process • Reproducible acquisition of optimal image series, for for novel applications where traditional methods would fail or not be flexible enough. Projects • Ellipsometric inspection of thin films on curved surfaces • Visual inspection of transparent objects • Automated detection of anomalies in industrial production • Holistic planning and optimisation of industrial optical measurements • Automated detection of anomalies in industrial production processes example by variation of illumination, focusing, camera position and optical filters • Classification of moving objects in aerial surveillance data • Automated interactive assistance and anomaly detection in • Fusion of data from the image series and from the other surgical treatment available information sources • Development of advanced optical 3D measurement • Online control of the variable acquisition parameters systems (Active Vision) • Open adaptive modeling of the environment for artificial • Inspection and reconstruction of partially or fully specular cognitive systems surfaces • Probabilistic planning methods for deflectometric surface inspection The variability of image acquisition is crucial if a single image does not fully capture the features of interest of a studied object or scene. The control system may then take multiple images, adjusting the parameters – such as the camera’s posi- tion or field of view (for example to improve visibility of the occluded objects) – or switching to different spectral bands. In combination with data fusion, this may provide a description quality that is hardly if at all achievable with other inspection methods. Facilitated by the availability of inexpensive camera and manipulation systems and by the progress in modeling and planning algorithms, this kind of approach paves the way • Interactive techniques for augmented reality environments • Detection of surface defects based on deflectometric measurement data • Person identification and face recognition in video data • Control of cyber-physical production systems • Methods of face registration, 3D reconstruction, and super-resolution in video data • Methods of classification in hyper-spectral inspection • Planning and execution of maneuvers for autonomous vehicles in traffic • Methods for specular 3D reconstruction 1 1 8 C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n

121

Head of department: Dr.-Ing. Miro Taphanel Phone +49 721 6091-389 miro.taphanel@iosb.fraunhofer.de www.iosb.fraunhofer.de/VBV 1 Laboratory setup for infra- red-deflectometry. 2 Deflectometric inspection in Robot / MiniCAVE laboratory. C o r e C o m p e t e n c e I m a g e E x p l o i t a t i o n 1 1 9 Infrastructure and equipment Robot laboratory: The laboratory’s industrial robot provides precise, automated, and reproducible adjustment of the image acquisition geometry. For example: illumination re-positioning allows very complex objects to be captured with a high degree of accuracy. In addition to traditional camera-based inspection, the laboratory is used for the inspection of specular objects with a deflectometric sensor head. Infrared deflectometric laboratory: Certain diffuse surfaces (such as metal sheets used in auto bodies) are specular when observed in the thermal infrared spectrum allowing their accurate inspection for the presence of dents, waves, and irregularities using deflectometry. However, unlike thermal infrared cameras, long-wavelength imaging devices are not readily available. The laboratory hosts several prototypes of devices to generate fast thermal deflectometric pattern series. In particular, one prototype utilizes a powerful laser to “draw” a pattern on a moving plastic band. MiniCAVE laboratory: Typically, the smaller the pattern projection screen, the longer a deflectometric inspection of a complex object takes. The radical way to increase the inspection area processed with a fixed camera-screen constellation is to completely enclose the object in a shell that serves as a screen. The MiniCAVE labo- ratory is equipped with digital projectors that enable a nearly complete coverage of the environment with encoding patterns (displayed on the walls and the ceiling). The research here is focused on calibration and measurement techniques in such environments and the associated advantages and challenges for the inspection tasks. 1 2

123

ADVISORY BOARD KURATORIUM FRAUNHOFER INSTITUTE OF OPTRONICS, SYSTEM TECHNOLOGIES AND IMAGE EXPLOITATION Prof. Dr.-Ing. Frank Artinger Hochschule Karlsruhe, Technik und Wirtschaft, Karlsruhe Dr. Fritz Merkle (Vorsitzender) OHB-System AG, Bremen Dipl.-Ing. Roland Bent Phoenix Contact GmbH & Co. KG, Blomberg Dr.-Ing. Horst Nasko Technologiemanagement, München Dr. Jürgen Bestle Hensoldt Sensors GmbH, Taufkirchen Dr.-Ing. Jörn Oprzynski Siemens AG, Karlsruhe Prof. Dr.-Ing. Barbara Deml Karlsruher Institut für Technologie KIT, Karlsruhe Dipl.-Geogr. Marion Sielemann Bundesministerium der Verteidigung, Bonn Prof. Dr. Cornelia Denz Westfälische Wilhelms-Universität, Münster Dr. Thomas Steckenreiter Samson AG, Frankfurt a. M. Prof. Dr.-Ing. Rüdiger Dillmann Karlsruher Institut für Technologie KIT, Karlsruhe Prof. Dr.-Ing. Christoph Stiller Karlsruher Institut für Technologie KIT, Karlsruhe Dr. Gerhard Elsbacher MBDA Deutschland GmbH, Schrobenhausen Dr.-Ing. Frank Weber Dr. Jan-Henning Fabian ABB AG, Ladenburg Dipl.-Ing. Robert Fetter Thüringer Ministerium für Wirtschaft, Wissenschaft und Digitale Gesellschaft, Erfurt Prof. Dr.-Ing. Christian Heipke Leibniz Universität Hannover, Hannover Thomas Kühn Airbus Defence and Space GmbH, Taufkirchen Dr. Jörg Kushauer Diehl BGT Defence GmbH & Co. KG, Überlingen Dr. Christian Martens Rheinmetall Electronics GmbH, Bremen Ministerialrat Dipl.-Ing. Norbert Michael Weber Bundesministerium der Verteidigung, Bonn Oberst Peter Webert Bundesministerium der Verteidigung, Berlin WE MOURN WIR TRAUERN Our advisory board member Dr. Sven Olaf, Airbus Defence and Space GmbH, of Immenstaad am Bodensee, sadly passed away on January 10th, 2018. We will honor his memory. 1 2 1

124

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E SCIENTIFIC CONSULTANTS WISSENSCHAFTLICHE BERATER Prof. Dr. Sebastian Abeck Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. habil. Pu Li Technische Universität Ilmenau, Ilmenau Prof. Dr. Michael Beigl Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr. Oskar von der Lühe Leibniz Gemeinschaft, Berlin Prof. Dr. Georg Bretthauer Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr. Alexander Pretschner Technische Universität München, München Prof. Dr.-Ing. Carsten Dachsbacher Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Fernando Puente León Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing Uwe Hanebeck Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Tanja Schultz Universität Bremen, Bremen Prof. Dr.-Ing. Björn Hein Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Uwe Sörgel Universität Stuttgart, Stuttgart Prof. Dr. Rüdiger Heintz DHBW Mannheim, Mannheim Prof. Dr.-Ing. Rainer Stiefelhagen Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr. Stefan Heiss Hochschule Ostwestfalen-Lippe, Lemgo Prof. Dr.-Ing. Stefan Streif Technische Universität Chemnitz, Chemnitz Ulrich Thönnessen Wolfgang Wittenstein Prof. Dr.-Ing. Dirk Westermann Technische Universität Ilmenau, Ilmenau Prof. Dr.-Ing. Michael Heizmann Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Stefan Hinz Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr. med. Wolfgang Hoffmann Universität Greifswald, Greifswald Prof. Dr. Wolfgang Karl Karlsruher Institut für Technologie (KIT), Karlsruhe Prof. Dr.-Ing. Kristian Kroschel Karlsruher Institut für Technologie (KIT), Karlsruhe 1 2 2

125

WORKING GROUPS MITARBEIT IN ARBEITSKREISEN Big Data Ljiljana Stojanovic (Leitung), Mathias Anneken, Yvonne Fischer, Erik Krempel, Alexander Pretschner, Sebastian Robert, Tobias Schuchert, Arne Schumann, Thomas Usländer, Oliver Warweg Counter-Improvised Explosive Device Ilja Kaufmann (Leitung), Jan Bartelsen, Stefan Brüstle, Yvonne Fischer, Jürgen Geisler, Wolfgang Groß, Klaus Jäger, Alexander Schwarz, Karin Stein, Gesetz zur Digitalisierung der Energiewende Ralf Marquardt (Leitung), Matty Al Doyaili, Jens Hörnlein, Björn Illing, Ronny Kreißl, Sven Möller, Dennis Rösch, Tobias Schunk, Andreas Vogel, Oliver Warweg Mensch-Roboter-Interaktion Christian Frese (Leitung), Sergej Bergen, Patrick Dunau, Yvonne Fischer, Christian Frese, Christian Frey, Björn Hein, Sascha Heymann, Björn Kroll, Christian Lengenfelder, Janko Petereit, Sebastian Robert, Rainer Stiefelhagen, Michael Voit Multispektrale Datenerfassung und Auswertung Thomas Längle (Leitung), Mohammad Abdo, Sebastian Bauer, Jürgen Beyerer, Mirko Bunzel, Fernando Chaves-Salamanca, Carsten Dachsbacher, Wolfgang Groß, Robin Gruna, Michael Heizmann, Wolfgang Krippner, Christian Negara, Fernando Puente León, Henning Schulte, Uwe Sörgel, Günter Struck, Max Winkelmann Oberflächeninspektion Michael Heizmann (Leitung), Jan Burke, Sebastian Höfer, Ilja Kaufmann, Thomas Längle, Mahsa Mohammadikaji, Thomas Müller, Christian Negara, Henning Schulte, Miro Taphanel Optimierung Liane Rublack (Leitung), Alexander Arnoldt, Therese Klarner, Steffen Nicolai Prognose Stefan Klaiber (Leitung), Alexander Arnoldt, Peter Bretschneider Regelungstechnik Benjamin Fischer (Leitung), Sebastian Flemming, Stefan Klaiber, Steffen Nicolai Standardisierte IT-Sicherheit Silvija Höger (Leitung), Peter Bretschneider, Barbara Essendorfer, Benjamin Fischer, Christian Haas, Birger Krägelin, Philipp Klotz, Erik Krempel, Oliver Niggemann, Bastian Schaller, Rainer Schönbein Unterwassersensorik Philipp Woock (Leitung), Jan Bartelsen, Katrin Braesicke, Gunnar Brink, Patrick Dunau, Christian Frey, Horst Hammer, Marco Jacobi, Silvia Kuny, Helge Renkewitz, Kevin Roesch, Torsten Pfützenreuter, Karsten Schulz, Detlev Sprung, APPEALS BERUFUNGEN Berufung auf die W3-Professur »Mechatronische Messsysteme« von Dr. Michael Heizmann am Institut für Industrielle Informationstechnik (IIIT), Karlsruher Institut für Technologie (KIT) zum 1.4.2016 Ernennung zum Professor für »Energieeinsatzoptimierung« von Dr.-Ing. Peter Bretschneider an der Technischen Universität Ilmenau zum 1.11.2016 1 2 3

126

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E HONORS AND AWARDS EHRUNGEN UND PREISE Jennifer Sander und ihrem Team Barbara Essendorfer, Norbert Heinze, Dr. Wolfgang Krüger und Michael Teutsch wurde der IOSB Wirtschaftsinnovationspreis 2015 verliehen für »operationelle Anpassung Stream Computing« Prof. Hartwig Steusloff wurde vom DIN mit der Beuth-Denkmünze ausgezeichnet. Diese hohe Auszeichnung des DIN erhielt er für sein besonderes Engagement im Sinne der Deutschen Normungsstrategie die Unterstützung von Innovation und Technikkonvergenz durch Normung und Standardisierung voranzutreiben Dr. Reinhard Ebert wurde vom Vorstand der Fraunhofer- Gesellschaft für seine langjährigen Verdienste für das IOSB und seine Vorgängerinstitute, sein großes Engagement bei der Gründung des IOSB und besonders für seine Tätigkeit für unser Institut über den nominellen Beginn seines Ruhe- standes hinaus mit dem Fraunhofer-Taler ausgezeichnet Dr. Wilmuth Müller und Frank Reinert wurden für ihren Entwurf der Unternehmens- und Systemarchitektur im EU-Projekt SALUS (Security And Interoperability in Next Generation PPDR Communication Infrastructures) mit dem International Critical Communications Award »Best Evolution to Future Broadband« ausgezeichnet Andreas Zepp wurde von der Firma Qioptiq für seinen Produktvorschlag bei dem Wettbewerb »Are you the Photonic Brain« mit dem 1. Platz prämiert Johannes Mulder wurde gemeinsam mit der NATO-Arbeits- gruppe MSG 106 (SPHINX) mit dem Scientific Achievement Award ausgezeichnet Reinhard Herzog wurde gemeinsam mit der NATO-Arbeits- gruppe MSG 106 (SPHINX) mit dem Scientific Achievement Award ausgezeichnet Dr. Jochen Meidow und Dr. Eckart Michaelsen erhielten den Journalpreis (Publikationspreis 2016) in der Kategorie »Artikel in wissenschaftlichen Zeitungen« Ph.D. Szymon Gladysz und Dr. Dimitri Bulatov erhielten den Konferenzpreis (Publikationspreis 2016) in der Kategorie »Artikel in Tagungsbändern« 1 2 4 Dr. Thomas Usländer und Prof. Thomas Rauschenbach erhielten den Veröffentlichungspreis (Publikationspreis 2016) in der Kategorie »Veröffentlichungen« Reinhard Herzog hat zusammen mit weiteren Autoren des Papers »Towards a New NATO Cerfitication Capability for HLA Interoperability« den SISO Award 2016 erhalten Dr. Torsten Pfützenreuter mit Team Ganzorig Baatar, Sebastian Matz, Prof. Thomas Rauschenbach, Helge Renkewitz, Daniel Weber wurde der IOSB Wirtschaftsinnovationspreis 2016 verliehen für das Projekt »Entwicklung eines ferngesteuerten Unterwasserfahrzeugs für die Überwachung der Wasserqualität« Dr. Dirk Feldmann und Melanie Pohl haben auf der International Conference on Computer Graphics Theory and Applications (GRAPP 2016) den Best Paper Award erhalten für: »Generating Straight Outlines of 2D Point Sets and Holes using Dominant Directions or Orthogonal Projections«, erhalten, Italien, Rome, 27.-29.2.2016 Stefan Becker, Hilke Kieritz, Dr. Wolfgang Hübner und Dr. Michael Arens haben auf der International Conference on Image and Signal Processing (ICISP) 2016 den Best Paper Award erhalten für: »On the benefit of state separation for tracking in image space with an interacting multiple model filter« erhalten, Kanada, Trois-Rivières, 30.5.-1.6.2016 Sergius Dyck, Daniel Haferkorn und Jennifer Sander haben auf der World Multi-Conference on Systemics, Cybernetics and Informatics (WMSCI 2016) den Best Paper Award für »An Organizational-Technical Concept to Deal with Open Source Software License Terms« erhalten, USA, Orlando, Florida, 5.-8.7.2016 Matthias Richter, Georg Maier, Dr. Robin Gruna, Prof. Thomas Längle und Prof. Jürgen Beyerer haben auf dem 2nd World Congress on Electrical Engineering and Computer Systems and Science (EECSS’16) für ihr Paper »Feature Selection with a Budget«, den Best Paper Award für ihr Paper »Feature Selection with a Budget«, erhalten, Ungarn, Budapest, 16.-17.8.2016 Andreas Bunte, Alexander Dietrich und Prof. Oliver Niggemann haben auf der International Conference on Emerging Technologies and Factory Automation (ETFA 2016) den Best Paper Award für: »Integrating Semantics for Diagnosis of Manufacturing System«, erhalten, Berlin, 6.-9.9.2016

127

Daniel Wegner und Endre Repasi haben auf der SPIE Security and Defense den Best Paper Award für »Image based performance analysis of thermal images« erhalten, Berlin, 10.-13.9.2016 Johannes Meyer hat auf der »2nd International Conference on Frontiers of Signal Processing« (ICFSP 2016) den Best Presentation Award für seinen Vortrag »Aquiring and Processing Light Deflection Maps for Transparent Object Inspection«, erhalten, Polen, Warschau, 15.-17.10.2016 Dr. Stefan Windmann, Jens Eickmeyer und Prof. Oliver Niggemann haben anlässlich der Eröffnung der Automation 2017 den atp Award in der Kategorie Industrie für »Fehler in Prozessen zuverlässig erkennen. Bewertung der Wahrscheinlichkeit fehlerhafter Messwerte« erhalten Dr. Bernd Eberle, Melanie Pohl, Dr. Gunnar Ritt, Michael Körber und Dr. Reinhard Ebert sind verantwortlich für den Erhalt des SET Panel Excellence Awards der 19-köpfigen internatio- nalen Wissenschaftlergruppe NATO Gruppe SET-198 für Ihre Arbeiten zu »Visible Laser Dazzle-Effects and Protection« Alwin Dimmeler erhielt für seinen Beitrag zur SET-190 Task Group on Phenomenology and Exploitation of Thermal Hyper- spectral Sensing den »2017 Scientific Achievement Award« der NATO Science and Technology Organization Henning Schulte mit Team Alexander Enderle, Jürgen Hock, Bettina Otten und Petra Riegel erhielten für das Projekt »Mockup - Mobiler Sensor zur Messung von Frische und Echtheit hochwertiger Produkte« den Wirtschaftsinnovations- preis Merlin Becker, Dr. Wolfgang Middelmann und Andreas Lenz erhielten für das Projekt »Future Combat Air System« den Wirtschaftsinnovationspreis Prof. Thomas Rauschenbach, Dr. Torsten Pfützenreuter, Sebastian Matz, Daniel Weber, Ganzorig Baatar, Helge Renkewitz erhielten für das Projekt »Remotely Operated Vehicle (ROV) für den Unterwassereinsatz« den Wirtschaftsinnovationspreis Georg Maier, Florian Pfaff, Carsten Pieper, Dr. Robin Gruna, Benjamin Noack, Harald Kruggel-Emden, Prof. Thomas Längle, Prof. Uwe D. Hanebeck, Siegmar Wirtz, Viktor Scherer und Prof. Jürgen Beyerer haben auf der »3rd Conference on Optical Characterization of Materials (OCM 2017)« den Best Paper Award für ihr Paper »Improving material characterization in sensor-based sorting by utilizing motion information«, erhalten, Karlsruhe, 22.-23.3.2017 Dr. Thomas Usländer hat auf der Hannover Messe den DIN Innovationspreis DIN SPEC 16593 für »RM-SA – Referenz- modell für Industrie 4.0 Servicearchitekturen – Grundkonzepte einer interaktionsbasierten Architektur« erhalten, Hannover, 25.4.2017 Arne Neumann, Marco Ehrlich, Lukasz Wisbniewski und Prof. Jürgen Jasperneite haben auf der 13th IEEE International Work- shop on Factory Communication Systems (WFCS 2017) den Best Paper Award für: »Towards monitoring of hybrid industrial networks« erhalten, Norwegen, Trondheim, 31.5.-2.6.2017 Arne Schumann, Lars Sommer, Johannes Klatte, Dr. Tobias Schuchert und Prof. Jürgen Beyerer haben auf dem AVSS-Workshop (International Workshop on Small-Drone Surveillance, Detection and Counteraction Techniques), den Best Paper Award für ihr Paper »Deep Cross-Domain Flying Object Classification for Robust UAV Detection« erhalten, Italien, Lecce, 28.8.2017 Pascal Kiefer hat auf der SPIE Security and Defense in der Konferenz »Target and Background Signatures« den Best Student Paper Award für: »Angular dependence of spectral reflection for different materials« erhalten, Polen, Warschau, 11.-14.9.2017 Daniel Manger und Dr. Dieter Willersinn haben auf der »7th International Conference on Image Processing Theory, Tools and Applications« (IPTA 2017) den Best Paper Award / 1st runner up für: »Enlarging the Discriminability of Bag-of-Words Representations with Deep Convolutional Features« erhalten, Kanada, Montreal, 28.11.-1.12.2017 1 2 5

128

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E SPECIAL EVENTS BESONDERE VERANSTALTUNGEN 2016 29. Sitzung des Fachausschusses 8.12 (ehemals 3.51) »Bild- verarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 22.1.2016, 12 Teilnehmer 4. VDI-Fachkonferenz »Big Data Technologien in der Produk- tion 2016« der VDI-Wissensforum GmbH, Leitung: Prof. M. Heizmann, Karlsruhe, 28.-29.6.2016, 70 Teilnehmer Chinesische Delegation von Geschäftsführern zur Schulung Industry 4.0 am AST, Ausrichter: AST Ilmenau, 28.-29.7.2016, 10 Teilnehmer Technologie-Stammtisch des Bundesverbandes mittelständischer Wirtschaft, Ausrichter: AST Ilmenau, 8.2.2016, 25 Teilnehmer 7. Wissenschaftscampus der Fraunhofer-Gesellschaft, Ausrichter: AST Ilmenau, 15.-16.8.2016, 34 Teilnehmer 3. Counter-IED Workshop, Fraunhofer IOSB, Organisation: Dr. Ilja Kaufmann, Ettlingen, 16.-17.2.2016, 30 Teilnehmer Doktorandenseminar, Ausrichter: AST Ilmenau, 7.9.2016, 9 Teilnehmer 50. Regelungstechnisches Kolloquium, Organisatorische Leitung: Prof. M. Heizmann, Boppard, 17.-19.2.2016, 30 Beiträge, 208 Teilnehmer 1st European Machine Vision Forum, Mitglied im Scientific Advisory Board: Prof. M. Heizmann, Heidelberg, 8.-9.9.2016, 130 Teilnehmer Programmausschuss und Tagungsleitung des VDI/VDE-GMA- Expertenforum »Modellbildung«, Organisation und Mitarbeit: Prof. M. Heizmann, Karlsruhe, 2.-3.3.2016, 31 Teilnehmer 1.Counter-UAS Kolloquium »Kleine UAV’s-Gefahren und Gegenmaßnahmen«, am IOSB, Karlsruhe, 16.3.2016, 90 Teilnehmer Sitzung des EMS-EDM Produktbeirates, Ausrichter: AST Ilmenau, Merseburg, 13.4.2016, 11 Teilnehmer Lehrveranstaltung: Industrie 4.0: Was steckt hinter der »vierten industriellen Revolution? Einführung: Trendbegriff "Industrie 4.0"«- begriffliche Klärung und Vielfalt des Begriffs, Leitung: Dr. M. Schleipen, Bonner Akademie für Forschung und Lehre praktischer Politik, Bonn, 14.9.2016, 50 Teilnehmer »2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016)«, Associate Editor und Mitglied im Award-Komitee: Prof. M. Heizmann, Baden-Baden, 19.-21.9.2016 30. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M. 25.4.2016, 10 Teilnehmer 31. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 23.9.2016, 12 Teilnehmer Girls’Day 2016, »Licht, Lärm und Krabbelei«, AST Ilmenau, 28.4.2016, 6 Teilnehmer Besuch des CNN anlässlich DeDAve, AST Ilmenau, 3.6.2016, 6 Teilnehmer VDMA-Veranstaltung: »Maschinen und Anlagen-bereit für Industrie 4.0« Abschlussveranstaltung der Projekte CSC, piCASSO, eApps4Production, itsowl-IV, SecurePLUGandWORK, Frankfurt a. M., 23.9.2016, 70 Teilnehmer Energiewirtschaftstour 2016, Mitglieder des Thüringer Land- tags besuchen das AST, Ilmenau, 9.6.2016, 8 Teilnehmer EMS-EDM PROPHET® Anwenderkonferenz, Ausrichter: AST Ilmenau, Heilbad Heiligenstadt, 14.-15.6.2016, 51 Teilnehmer TRM-Workshop, Fraunhofer IOSB, Organisation: J. Mündel, Ettlingen, 28.-29.6.2016, 10 Teilnehmer 78. Sitzung des Fachausschusses 1.10 »Grundlagen Mess- systeme« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 26.9.2016, 12 Teilnehmer Fachkongress Industrial Analytics & Big Data in der Automobil- industrie, Leitung des Themenblocks »Industrial Dataspace Use Cases« und Vortrag »Datenanalyse und IT-Sicherheit im Smart Factory Web«: Dr. T. Usländer, Berlin, 28.9.2016, 80 Teilnehmer 1 2 6

129

Konferenz »Machine Learning for Cyber-Physical-Systems« Beiratsmitglieder: C. Frey, Prof. M. Heizmann, Dr. W. Hübner, Organisator: Dr. C. Kühnert, Karlsruhe, 29.9.2016, 25 Teilnehmer Podiumsdiskussion Virtual Computing: Spielend Fertigen. IT & Business 2016, Stuttgart, 7.10.2016, 100 Teilnehmer 9. Fraunhofer Vision Technologietag 2016, Fraunhofer- Zentrale, München, 19.-20.10.2016 Branchenworkshop IT–Sicherheit für Industrie 4.0, Präsentation des Lernlabor Cybersicherheit–Sicherheit für die industrielle Produktion, Tag der Cybersicherheit, Fraunhofer-Forum Berlin, Berlin, 20.10.2016, 30 Teilnehmer Chinesische Delegation von Geschäftsführern zur Schulung Industry 4.0 am AST, Ausrichter: AST Ilmenau, 27.10.2016, 30 Teilnehmer Seminar FA 1.07 »Daten- und Informationsfusion« der Carl-Cranz-Gesellschaft e. V., Organisation und Leitung: Prof. M. Heizmann, Karlsruhe, 7.-10.11.2016, 8 Teilnehmer Panel discussion: »Preparing your architecture for serving IoT technologies: Addressing platforms, connectivity and security challenges« IoT World Europe, Irland, Dublin, 21.11.2016, 80 Teilnehmer Seminar FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« der Carl-Cranz Gesellschaft e.V., Karlsruhe, 22.-23.11.2016, 29 Teilnehmer Fraunhofer VISION-Seminar mit Praktikum »Inspektion und Charakterisierung von Oberflächen«, Fraunhofer IOSB, Karlsruhe, 7.-8.12.2016 »IT-Sicherheit in der Produktion«, Kooperationsveranstaltung mit der Innovationsallianz der TechnologieRegion Karlsruhe, Leitung und Organisation: Dr. C. Haas, Dr. O. Sauer, Karlsruhe, 08.12.2016, 35 Teilnehmer Forum »Bildverarbeitung« veranstaltet durch das Fraunhofer IOSB und das IIIT, Organisation, Mitarbeit im Program- mausschuss und Leitung: Prof. M. Heizmann, Karlsruhe, 1.-2.12.2016, 25 Beiträge, ca. 50 Teilnehmer Seminar Oberflächenmesstechnik, Fraunhofer-Allianz Vision, Karlsruhe, 7.-8.12.2016 2017 8. NRW Symposium »Sicher in der digitalen Welt? Chancen für Unternehmen durch Schutz vor Cyberangriffen«, Forum »Sicherheitslabor für Industrie 4.0«, Leitung: Dr. C. Haas, Düsseldorf, 12.1.2017, 200 Teilnehmer MAROS 2017–Maritime Robotik und Sensorik, Ausrichter: IOSB-AST Ilmenau, Gesellschaft für Maritime Technik, BMWI, Pro Tempre, Potsdam, 12.-13.1.2017, 80 Teilnehmer 32. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 20.1.2017, 18 Teilnehmer 79. Sitzung des Fachausschusses 1.10 »Grundlagen Mess- systeme« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 10.2.2017, 19 Teilnehmer Sitzung des EMS-EDM Produktbeirates, Ausrichter: AST Ilmenau, Evangelisches Augustinerkloster, Erfurt, 14.2.2017, 11 Teilnehmer 51. Regelungstechnisches Kolloquium, Organisatorische Leitung: Prof. M. Heizmann, Boppard, 15.-17.2.2017, 30 Beiträge, 199 Teilnehmer Poster presentation: »Network and Topology Models to Support IDS Event Processing«, 3rd International Conference on Information Systems Security and Privacy ICISSP, Portugal, Porto, 18.-22.2.2017 Research and Strategic Meeting: ONERA/DOTA and Fraunhofer IOSB on Optronics and Optics, Frankreich, Paris, 7.3.2017, 5 Teilnehmer 1. Industrial Vision Conference der Süddeutscher Verlag Veranstaltungen GmbH, Mitarbeit im Fachbeirat und Moderation: Prof. M. Heizmann, Ludwigsburg, 8.-9.3.2017, 60 Teilnehmer Eröffnung des Lernlabors Cybersicherheit mit dem Demonstrator »IT Sicherheitslabor für Industrie 4.0«, Lemgo, 16.3.2017 1 2 7

130

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E SPECIAL EVENTS BESONDERE VERANSTALTUNGEN Japanische Delegation und nrw.invest, Fraunhofer IOSB-INA, Lemgo, 18.3.2017, 30 Teilnehmer Berliner Energietage, Fachkonferenz »Digitalisierung der Energiewelt – Herausforderungen und Lösungsansätze«, Fraunhofer-Allianz Energie, Berlin, 5.5.2017 Special Session »Geospatial Aspects in Industry 4.0«, Techni- cal Committee Meeting, Open Geospatial Consortium (OGC), Leitung: Dr. T. Usländer, Niederlande, Delft, 20-24.3.2017, 100 Teilnehmer OCM-SpectroNet Collaboration Conference 2017, Fraunhofer IOSB, Karlsruhe, 21.3.2017, 65 Teilnehmer 3rd International Conference on Optical Characterization of Materials (OCM 2017), Organisation, Leitung und Mitarbeit im Programmausschuss: Prof. T. Längle, Fraunhofer IOSB, Karlsruhe, 22.-23.3.2017, 87 Teilnehmer Panel Discussion: »IoT & Industry 4.0 Facilitating of Manufacturing (How Sensors, connectors, and Big Data will impact your business)«, Global Smart Manufacturing Summit, Frankfurt a. M., 29.-31.3.17, 200 Teilnehmer OpenFactoryDay – Tag der offenen Tür in der SmartFactoryOWL, Fraunhofer IOSB-INA, Lemgo, 13.5.2017, 600 Teilnehmer VDI Wissensforum Big Data in der Produktion, Ausrichter: VDI, Karlsruhe, 16.-17.5.2017, 50 Teilnehmer Seminar »Vorstellung der Arbeiten der Gruppe Optik der Atmosphäre & Meteorologie / Signatorik«, Stumeta (Studentische Meteorologentagung 2017), Leitung: Dr. K. Stein und Dr. D. Sprung, 25.5.2017, 16 Teilnehmer China Engineering Cost Association (CECA) | Workshop, Fraunhofer IOSB-INA, Lemgo, 19.6.2017, 16 Teilnehmer 34th EDA CapTech EOST Meeting, Fraunhofer IOSB, Organisation: Dr. H. Bürsing, Ettlingen, 20.-21.6.2017, 30 Teilnehmer OSA Konferenz: »Quantum Information and Measurement (QIM)-IV: Quantum Technologies«, Université Pierre et Marie Curie, Frankreich, Paris, 5.-7.4.2017 EDA ECOMOS Workshop, Fraunhofer IOSB, Organisation: Dr. H. Bürsing, Ettlingen, 21.-22.6.2017, 30 Teilnehmer Delegation Kompetenzzentrum Mittelstand Österreich, Fraunhofer IOSB-INA, Lemgo, 6.4.2017, 18 Teilnehmer EMS-EDM PROPHET Anwendertage für Kunden von EMS-EDM PROPHET®, Ausrichter AST Ilmenau, Jena, 21.-22.6.2017, 46 Teilnehmer Panel discussion: »Talk@3: Accelerating the Industrial Inter- net through Testbeds«, Hannover Messe Industrie, Hannover, 24.-28.4.2017, 80 Teilnehmer Delegation Kaiyuan, China in der SmartFactoryOWL, Fraunhofer IOSB-INA, Lemgo, 25.4.2017, 25 Teilnehmer Deutsch-Chinesische Allianz in der SmartFactoryOWL, Fraunhofer IOSB-INA, Lemgo, 26.4.2017, 20 Teilnehmer Girls’Day 2017, Ausrichter: AST Ilmenau in Kooperation mit dem IDMT, Ilmenau, 27.4.2017, 15 Teilnehmer 33. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 28.4.2017, 9 Teilnehmer 12th International ITBM&S Workshop (IR Target and Back- ground, Modeling and Simulation), Fraunhofer IOSB und ONERA/DOTA, Organisation und Durchführung: E. Repasi und Dr. K. Braesicke, Ettlingen, 26.-29.6.2017, 25 Teilnehmer AUTOMATION 2018, Ausrichter: VDI, Baden-Baden, 27.6.2017, 450 Teilnehmer Delegation RTB, Korea, Fraunhofer IOSB-INA, Lemgo, 12.7.2017, 30 Teilnehmer Abstimmungsgespräch »IR-Technologie für optronische Sensoren (ATOS)«, Fraunhofer IOSB, Organisation: Dr. R. Ebert, J. Fartak, Ettlingen, 13.7.2017, 34 Teilnehmer Erfahrungsaustausch Industrial Security, Esslingen, 19.7.2017, 25 Teilnehmer 1 2 8

131

INTERNATIONAL GUESTS AND VISITING SCIENTISTS INTERNATIONALE GÄSTE UND GASTWISSENSCHAFTLER 2017 CLEO Pacific Rim Conference, The Optical Society (OSA), Singapur, 31.7.-4.8.2017 Chinesische Delegation, Fraunhofer IOSB-INA, Lemgo, 22.8.2017, 27 Teilnehmer 80. Sitzung des Fachausschusses 1.10 »Grundlagen Messsys- teme« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Berlin, 28.9.2017, 14 Teilnehmer 34. Sitzung des Fachausschusses 8.12 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Organisation und Leitung: Prof. M. Heizmann, Frankfurt a. M., 6.10.2017, 10 Teilnehmer it’s OWL Transfertage 2017, Ausrichter: it’s OWL, Lemgo, 10.-11.10.2017, 250 Teilnehmer Fachtagung Cybersicherheit, Fraunhofer IOSB-INA, ARROW, Lemgo, 18.10.2017, 55 Teilnehmer Industrie 4.0–Kompakt, Fraunhofer IOSB-INA, Lemgo, 19.10.2017, 20 Teilnehmer ML4CPS–Machine Learning for Cyber Physical Systems and Industry 4.0, Fraunhofer IOSB-INA und SV-Veranstaltungen, Lemgo, 25.-26.10.2017, 75 Teilnehmer Qiucheng Li, China, PhD-Student, China Agriculture University, 1.9.2012-31.12.2017 Duc Long Nguyen, DAAD-Stipendium, Vietnam, 1.10.2013-31.10.2017 10. Technologietag 2017 und Jubiläumskongress 20 Jahre Fraunhofer Vision, Fraunhofer-Entwicklungszentrum Röntgen- technik EZRT, Fürth, 25.-26.10.2017 Prof. Lex van Eijk, TNO Den Haag, Universität Nantes/ Frankreich, seit 6.10.2014 Tagung »Prüfprozesse in der industriellen Praxis« der VDI- Wissensforum GmbH, Mitarbeit im Programmausschuss und Sitzungsleitung: Prof. M. Heizmann, Erfurt, 15.-16.11.2017, 21 Vorträge Fraunhofer VISION-Seminar mit Praktikum: Inspektion und Charakterisierung von Oberflächen, Fraunhofer IOSB, Karlsruhe, 5.-6.12.2017 VDI Wissensforum Big Data in the Production Line, Ausrichter: VDI, Düsseldorf, 12.12.2017, 50 Teilnehmer Dewei Li, Engineer, National Deep Sea Center, China, Qingdao, 30.6.2015-31.5.2016 Shuhan Zhang, Vice Chief Engineer, Beijing Water Science and Technology Institute (BWSTI), China, 10.-15.10.2016 Tsend Davaa, Projektpartner, Mongolei, 21.-28.1.2017 Wie Li, PhD-Student, China, seit 16.3.2017 M.Sc. Shuhui Qu, Stanford University, 6.7.2017-7.9.2017 Sewada, Jitendra Singh, Université Grenoble Alpes, seit 4.8.2017 Prof. Dr. Jie Wang, Stanford University, 16.-21.11.2017 1 2 9

132

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E TRADE FAIRS AND EXHIBITIONS MESSEN UND FACHAUSSTELLUNGEN 2016 Learntec 2016 Karlsruhe, 26.-28.1.2016 Exponat: - Lost Earth Ocean International UK, London, 15.–17.3.2016 Präsentationsstand DEDAVE ThEGA-Forum 2016 Weimar, 18.4.2016 Präsentationsstand der Abteilung NRG HANNOVER MESSE 2016 Hannover, 25.-29.4.2016 Exponate: - Tiefsee-Unterwasserfahr- zeug DEDAVE - m²Assist - Autonomer Landroboter IOSB.amp Q2 - IT-Sicherheitslabor - Smart Factory Web - Plug & Work Control 2016 – 30. Internationale Fachmesse für Qualitätssicherung Stuttgart, 26.-29.4.2016 Gemeinschaftsstand Fraunhofer-Allianz Vision Exponate: - Deflektometrie - PuritySurf zur Inspektion von Oberflächen auf Beschichtungs- oder Reflek- tanzfehler im Durchlauf 1 3 0 AFCEA Fachausstellung 2016 Bonn Bad Godesberg, 27.- 28.4.2016 Exponate: - Digitaler Lagetisch und mobile Endgeräte - Lost Earth IFAT München, 30.5.-3.6.2016 Gemeinschaftsstand Fraunhofer-Allianz SysWasser Exponat: - Digitale Wasserlösungen 7th International Confe- rence on Spectroscopic Ellipsometry (ICSE-7) Berlin, 6.6.2016 Präsentation des Ellipsome- ters mit unserer Partnerfirma SENTECH Instruments GmbH GPEC 2016 Leipzig, 7.-9.6.2016 Exponat: - Digitaler Lagetisch und mobile Endgeräte World Conference on Non-Destructive Testing (WCNDT 2016) München, 13.-17.6.2016 Exponat: - Sortiersystem blackValue 2017 2016 IEEE International Conference on Multisen- sor Fusion and Integration for Intelligent Systems (MFI 2016) Baden-Baden, 19.-21.9.2016 Exponat: - Experimentalsystem TableSort It-sa Nürnberg, 18.-20.10.2016 Exponat: - IT-Sicherheitslabor Learntec 2017 Karlsruhe, 24.-26.1.2017 Exponat: - Lost Earth und Virtual Reality Image Exploitation Workspace (VIEW) E-world energy & water 2017 Essen, 7.-9.2.2017 Präsentationsstand EMS- EDM PROPHET®, Exponat: - EMS-EDM PROPHET® Myjob OWL Bad Salzuflen, 10.-12.3.2017 Exponat: - Augmented Reality Handar- beitsplatz Fachforum »Energiespeicherung mit Sektorkopplung« Erfurt, 13.2.2017 Fraunhofer IOSB-AST als wissenschaftlicher Partner IT Sicherheitskonferenz Selbstbestimmt und sicher in der digitalen Welt Berlin, 14.-16.2.2017 Exponat: - IT Sicherheitslabor für Industrie 4.0 Industrial Vision I Ludwigsburg, 8.-9.3.2017 Präsentationsstand Deflekto- metrie Fraunhofer Vision- Technologietag Fürth, 19.-20.10.2016 Exponat: - Deflektometrie inova - Die Karrieremesse an der TU Ilmenau, Ilmenau, 25.10.2016 Gemeinschaftsstand »Fraunhofer in Thüringen« VISION-VDMA- Technologietag Stuttgart, 8.-11.11.2016 Präsentation des Karlsruher Zentrum für Material- signaturen-KCM 6. Erneuerbare-Energien- Konferenz »Thüringen Erneuer!bar« Weimar, 17.11.2016 Stand mit Vorstellung Abteilung NRG Academix Erfurt 2016 Erfurt, 8.12.2016 Präsentation des Fraunhofer- IOSB-AST

133

AFCEA Fachausstellung 2017 Bonn Bad Godesberg, 27.-28.4.2017 Exponate: - Digitaler Lagetisch: Lagevisualisierung - Blickgesteuerter 360°-View aus dem Inneren eines Fahrzeugs - Lost Earth Deterministic Ethernet Form Österreich, Wien, 27.-28.4.17 Exponat: - TSN-Demonstrator 1.0 Control 2017 – 31. Internationale Fachmesse für Qualitätssicherung Stuttgart, 9.-12.5.2017 Gemeinschaftsstand Fraunhofer-Allianz Vision Exponate: - Miniaturausgabe einer Schüttgutsortier-Anlagen TableSort: Prozesskette für hyperspektrale Analysen - Deflektometrie ThEGA-Forum 2017 Weimar, 10.5.2017 Präsentationsstand der Abteilung NRG Forum ElektroMobilität Berlin, 1.-2.6.2017 Exponat: - Ein Angriffsszenario auf kooperatives Fahren CeBIT 2017 Hannover, 20.-24.3.2017 Acatech-Gemeinschaftsstand »Vernetzte Autonome Systeme« Exponate: - QUANJO / Projekt SENEKA - Autonomer Bagger WASSER Berlin, 28.-31.3.2017 IWRM-MoMo Präsentation HANNOVER MESSE 2017 Hannover, 23.-28.4.2017 Exponate: - 3D Printing in vernetzter Produktion - Augmented Reality Handar- beitsplatz BMBF –Gemeinschaftsstand »Autonome Systeme« Exponate: - QUANJO / Projekt SENEKA - m²Assist - Digitaler Lagetisch als Kontrollstation für den autonomen Bagger BoB it’s OWL Gemeinschafts- stand Exponat: - VersatileProductionSystem (VPS) VDI Gemeinschaftsstand Exponat: - Customized Production System (CPS) Gemeinschaftsstand Mobilitec der Baden- Württembergischen Landesagentur eMobil-BW Exponate: - Ein Angriffsszenario auf kooperatives Fahren - Autonomer Bagger - Lernlabor Cybersicherheit - Smart Factory Web - Plug & Work TRAUMBERUF IT & TECHNIK-Schülermesse Köln, 2.6.2017 Gemeinschaftsstand mit Fraunhofer Karriere und Hochschule OWL Exponat: - Roboter »Nao« 5. Bayerischen Erlebnistag der Ernährung 2017 München, 25.6.2017 Exponat: - FoodScaner Global Learning Council Summit 2017 Berlin, 29.-30.6.2017 Exponat: - Lost Earth und Virtual Reality Image Exploitation Workspace (VIEW) TSN/A Conference 2017 Stuttgart, 20.-21.9.17 Exponat: - TSN-Demonstrator 2.0 IT & Media Futurecongress Bielefeld, 25.9.2017 Gemeinschaftsstand Digital in NRW Exponat: - Augmented Reality Hand- arbeitsplatz BIZPLAY 2017 Karlsruhe, 28.9.2017 Exponat: - Lost Earth und Virtual Reality Image Exploitation Workspace (VIEW) IoT Solutions World Spanien, Barcelona, 3.-5.10.2017 Exponat: - Smart Factory Web Pol Eco System 2017 Posen, 16.-20.10.2017 BMBF-Gemeinschaftsstand, Präsentation IOSB-AST inova-Die Karrieremesse an der TU Ilmenau Ilmenau, 24.-25.10.2017 Gemeinschaftsstand »Fraunhofer in Thüringen« FMB Zuliefermesse Maschinenbau Bad Salzuflen, 6.-8.11.2017 it’s OWL Gemeinschaftsstand Exponat: - Augmented Reality Hand- arbeitsplatz 2. Fachtagung Industrie 4.0 und das Internet of Things Ostfildern/Stuttgart, 21.- 22.11.2017 Exponat: - Augmented Reality Hand- arbeitsplatz oder HoloLens TRAUMBERUF IT & TECHNIK-Schülermesse Hamburg, 22.11.2017 Gemeinschaftsstand mit Fraunhofer Karriere und Hochschule OWL Exponat: - Roboter »Nao« sps ipc drives Nürnberg, 28.-30.11.2017 Exponat: - TSN-Demonstrator 2.0 E-world energy & water 2018 Essen, 8.-10.2.2018 Präsentationsstand EMS- EDM PROPHET®, Exponat: - EMS-EDM PROPHET® 1 3 1

134

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E PATENTS, UTILITY MODELS AND TRADEMARKS PATENTE, GEBRAUCHSMUSTER UND MARKEN ERTEILTE PATENTE Anstett, G.; Eberle, B.; Ritt, G.: Verfahren und Schutzvorrichtung zur Begrenzung einer optischen Leistung DE 10 2014 213 970.8 Erteilungsdatum: 20.10.2016 Matz, S.; Pfützenreuter, T.; Weber, D.: Gehäuse für Propellerantriebsaggregat DE 10 2013 209 682.8 Erteilungsdatum: 28.12.2017 Bernard, T.; Hain, Bogdahn, T.; Ganz, O.: Verfahren zur Herstellung eines zylinderförmigen Bauteils aus Glas durch Elongieren DE 10 2011 116806.4 Erteilungsdatum: 29.12.2015 Beyerer, J.: Vorrichtung und Verfahren zur Online-Kontrolle von Trinkwasser DE 10 2007 012 970.1 Erteilungsdatum: 17.2.2016 Brink, G.; Pfützenreuter, T.; Rauschenbach, T.: System zum Ausbringen und Bergen eines Unterwasserfahrzeugs DE 20 2016 101 197.3 Erteilungsdatum: 7.6.2017 Gruna, R.; Vieth, K.-U.; Schulte, H.; Längle, T.; Hanebeck, U.; Baum, M.; Noack, B.: Verfahren und Vorrichtung zur Schüttgutsortierung durch prädiktive Multiobjektverfolgung DE 10 2014 203 638. Erteilungsdatum: 5.12.2017 Hartrumpf, M.: Vorrichtung und Verfahren zur optischen Charakterisierung von Materialien DE 10 2010 046 438.4 Erteilungsdatum: 29.12.2015 Krempel, E.; Peinsipp-Byma, E.; van de Camp, F.; Voit, M.: Vorrichtung und Verfahren zur Wiedergabe von Inhalten basierend auf von einem Anwender autorisierten Daten DE 10 2015 206 733.5 Erteilungsdatum: 26.10.2017 Michaelsen, E.; Arens, M.; Scherer-Negenborn, N.: Verfahren, Vorrichtung und Computerprogramm zur Modellauswahl bei der Objektverfolgung mit projizierenden Messungen DE 10 2015 223 790.7 Erteilungsdatum: 19.10.2016 Pak, A.: Vorrichtung und Verfahren zum optischen Vermessen von Gegenständen mittels spiegelndem Fluss und Stereo-Regularisierung DE 10 2014 224 274 Erteilungsdatum: 22.9.2016 Pak, A.: Verfahren und Vorrichtung zur Übertragung mechanischer Energie DE 10 2012 221 907.2 Erteilungsdatum: 10.11.2016 Ritt, G.; Eberle, B.; Anstett, G.; Ebert, R.; Beyerer, J.: Personal Laser protection device EP 2012 070258 Erteilungsdatum: 1.3.2017 Scherer-Negenborn, N.; Lutzmann, P.; Scherer-Klöckling, C.: Vorrichtung und Verfahren zur Messung von Schwingungen 131 987 85.1 Erteilungsdatum: 23.11.2016 Vieth, K.-U.: Verfahren zum Einrichten einer dem optischen Identifizieren von Objekten dienender Anlage, Labor- bildaufnahmesystem zum Durchführen eines solchen Verfahrens und Anordnung umfassend das Laborbild- aufnahmesystem sowie die Anlage DE 2012 001 868.1 Erteilungsdatum: 7.6.2017 Matz, S.; Pfützenreuter, T.; Weber, D.: Speichervorrichtung DE 10 2013 216 271.5 Erteilungsdatum: 31.5.2017 1 3 2

135

OFFENGELEGTE PATENTE Arens, M.; Michaelsen, E.; Meidow, J.; Hebel, M.: System und Verfahren zur interaktiven Rekonstruktion von Artefakten und anderen zerlegten Gegenständen DE 10 2015 205 357.1 Offenlegungsdatum: 13.10.2016 Jakoby, A.; Helwig, D.: Hardware-Kryptomodul und System zur Kommunikation mit einer externen Umgebung DE 10 2013 223366.3 Offenlegungsdatum: 10.3.2016 Beyerer, J.; Brink, G.: System zur Navigation eines autonom navigierenden Tauchkörpers beim Einfahren in eine Fangstation EP 16 163 313.6 Offenlegungsdatum: 5.10.2017 Krempel, E.; Kaufmann, M.: Authentisierungs-Stick DE 10 2014 219 297.8 Offenlegungsdatum: 13.7.2017 Brink, G.: Autonomes Unterwasserfahrzeug und Stapelvorrichtung DE 10 2016 221 597.3 Offenlegungsdatum 14.12.2017 Brink, G.; Barth, C.: Bergevorrichtung und zugehöriges Verfahren DE 10 2016 210 128.5 Offenlegungsdatum: 14.12.2017 van de Camp, F.: Medikamentenaufbewahrungsbehälter, System zur Überwachung der Entnahme eines Medikaments und Verfahren zur automatischen Füllstandsüberwachung von Medikamenten DE 10 2014 220 178.0 Offenlegungsdatum: 7.4.2016 Dengler, S.; Hege, C.; Eberle, B.; Muller, O.: Verfahren zur Begrenzung einer optischen Leistung, Leistungsbegrenzer und damit ausgestattetes Gerät EP 2015 15 71 4507.9 Offenlegungsdatum: 15.3.2017 Hammer, J.-H.; Voit; M. Verfahren und Vorrichtung zum kamerabasierten Messen der Position und Pose von Handwerkzeugen DE 10 2015 206 791.2 Offenlegungsdatum: 20.10.2016 Hartrumpf, M.; Längle, T.; Heizmann, M.; Schulte, H.; Monari, E.; Vogelbacher, M., Gruna, R.: Vorrichtung und Verfahren zur Qualitätskontrolle transparenter Objekte DE 10 2014 217 771.5 Offenlegungsdatum: 9.3.2016 Kroschel, K.; Willersinn, D.; Chaudhary, H.; Scheers, B.; van Wijngaarden, S.; Hoffmann, B.: Method and system for measuring location and / or orientation EP 16 151 513.5 Offenlegungsdatum: 20.7.2017 Längle, T.; Karl, W.; Maier, G.; Bromberger, M.; Kicherer, M.; Becker, T.: Optisches Sortiersystem sowie entsprechendes Sortierverfahren DE 10 2016 210 482.9 Offenlegungsdatum: 21.12.2017 Längle, T.; Gruna, R.; Nüßler, D.; Küter, A.; Kieninger, M.; Brandt, C.: Vorrichtung und Verfahren zur Analyse von Materialien in einem Materialstrom sowie Sortieranordnung DE 10 2016 202 530.9 Offenlegungsdatum: 24.8.2017 Negara, C.; Hartrumpf, M.: Konfigurierbarer Retroflex-Sensor zur verbesserten Charakterisierung der Eigenschaften einer Probe DE 10 2016 209 723.7 Offenlegungsdatum: 7.12.2017 Negara, C.; Hartrumpf, M.: Vorrichtung zur Bestimmung des Polarisationszustandes durch Messung von mindestens drei Stokes-Parametern DE 10 2016 209 706.7 Offenlegungsdatum: 7.12.2017 1 3 3

136

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E PATENTS, UTILITY MODELS AND TRADEMARKS PATENTE, GEBRAUCHSMUSTER UND MARKEN Wortmarke »Aronnax« DE 30 2016 103 104 Veröffentlichungstag 6.4.2016 Wortmarke »JVP« DE 30 2016 1110 265 Veröffentlichungstag 14.11.2016 Wortmarke »Recomotion« DE 30 2017 107 563 Veröffentlichungstag 28.7.2017 Bildmarke »Aronnax« DE 30 2016 103 383.5 Veröffentlichungstag 13.4.2016 Wort- / Bildmarke »Karlsruher Forschungsfabrik« DE 30 2016 102 249.3 Veröffentlichungstag 11.3.2016 Wort- / Bildmarke »Lemgo Digital« DE 30 2017 106 985.9 Veröffentlichungstag 13.7.2017 Perpeet, D.; Dörfel, R.; Meidow, J.: Verfahren zur Größenbestimmung von Flächen, Datenträger, Daten repräsentierende Signalfolie und Smartphone DE 10 2014 221 093.3 Offenlegungsdatum: 21.4.2016 Schatz, V.: Messverfahren, Messanordnung und Computerprogrammprodukt DE 10 2015 206 013.6 Offenlegungsdatum: 6.10.2016 Schatz, V.: Messverfahren zur Bestimmung des Zeitverhaltens von Kameras und Messanordnung DE 10 2015 206 012.8 Offenlegungsdatum 6.10.2016 Taphanel, M.; Zink, R.: Chromatisch konfokale Sensoranordnung EP 2014 063968 Offenlegungsdatum: 7.1.2016 Schulte, H.; Brode, T.: Urinanalyse im Durchfluss in Echtzeit mittels spektraler Messung DE 10 2015 214 926.9 Offenlegungsdatum: 19.5.2016 Schulte, H.; Gruna, R.; Hofbauer, W.: Vorrichtung und Verfahren zur Schimmeldetektion an Baustoffoberflächen DE 2015 219 540.6 Offenlegungsdatum: 13.4.2017 Werling, S.; Stephan, T.: Verfahren und Vorrichtung zur Bestimmung der Topografie einer Oberfläche DE 10 2015 203 396.1 Offenlegungsdatum: 25.8.2016 Willersinn, D.; Grinberg, M.; Kroschel, K.; Haberland, U.; Grüdel, D.; Hamm, W.: Rauschrobuste Objektortung mit Ultraschall DE 10 2014 110 187.1 Offenlegungsdatum: 21.1.2016 1 3 4

137

PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN Adomeit, U.: - Mitglied der NATO-Gruppe SET-209 »Exploitation of Human Signatures for Threat Determination« - Vorsitzender der NATO-Gruppe SET-217 »Assessing and Modeling - Member of IEEE Intelligent Transportation Systems - Member of Society for Industrial and Applied Mathematics (SIAM) - Member of The International Society for Optical Engineering (SPIE) - Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung the Performance of Digital Night Vision Image Fusion« e.V. (DAGM) - Mitglied der NATO-Gruppe SET-264 »Short Wave Infrared Technology« - Mitglied im VDE - Mitglied im Beirat der Deutschen Initiative für Netzwerkinformation Arnoldt, A.: - Mitglied und Vertreter der Abt. NRG des IOSB-AST im Fraunhofer- Netzwerk Windenergie - Mitglied im VDE / DKE Backendsysteme - Mitglied im Fraunhofer EU-Netzwerk - Mitglied im IOSB EU-Netzwerk (DINI) - Mitglied im Präsidium der Deutschen Gesellschaft für Wehrtechnik (DWT) - Mitglied im Beirat der Zeitschrift »Strategie und Technik« - Mitglied im Beirat der Zeitschrift »Europäische Sicherheit und Technik« - Member of the Advisory Board of the European Journal for Security Reserarch, Springer-Verlag - International Member of the Advisory Board, Institute for Computer Azarian, A.: - Mitglied der NATO-Gruppe SCI-264 »High Energy Laser Weapons: Science and Control (SZTAKI), Hungarian Academy of Sciences, Budapest Tactical Employment in the Shared Battlespace« - Member of the Editorial Board der Buchreihe “Technologien in der Becker, S.: - Program Committee: SPIE Security + Defence 2016 »Optics and Photonics for Counterterrorism, Crime Fighting, and Defence« - Program Committee: SPIE Security + Defence 2017 »Optics and Photonics for Counterterrorism, Crime Fighting, Forensics and Surveillance« Beyer, D.: - Mitarbeit im BITKOM Beyerer, J.: - Vorsitzender des Fraunhofer-Verbundes für Verteidigungs- und Sicherheitsforschung VVS - Mitglied des Präsidiums der Fraunhofer-Gesellschaft - Mitglied des Präsidiums der Deutschen Gesellschaft für Wehrtechnik e.V. intelligenten Automation”, Springer-Verlag - Member of the Program Committee of the 11 Future Security, Berlin, 13.-14.9.2016 - Konferenzleiter der vom VDI Wissensforum organisierten Konferenz »Big Data Technologien in der Produktion«, Karlsruhe, 28.-29.6.2016 - Awards Chair, IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016), Baden-Baden, 19.-21.9.2016 - Conference Chair, Machine Learning for Cyber-Physical-Systems ML4CPS, Karlsruhe, 29.9.2016 - Conference Chair der Conference Automated Visual Inspection and Machine Vision, SPIE Optical Metrology, München, 25.-29.6.2017 - Conference Chair, 3. Fachkonferenz Maschinelles Lernen in der Produktion ML4CPS, Lemgo, 25.-26.10.2017 - Mitglied der Jury NEO2016 – Der Innovationspreis der TechnologieRegion Karlsruhe - Mitglied im Programmausschuss Forum Bildverarbeitung 2016 - Mitglied des Kuratoriums des Forschungszentrums Informatik (FZI), (International Forum on Image Processing), Karlsruhe, 1.-2.12.2016 Karlsruhe - Vorstandsmitglied des Kuratoriums der Hochschule Karlsruhe Technik und Wirtschaft - Leitung des Technischen Forums der Firma inspectomation GmbH, Mannheim - General Chair der 3nd International Conference on Optical Characterization of Materials (OCM 2017), Karlsruhe, 21.-23.03.2017 - General Chair der 12th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS 2017), Karlsruhe, 29.-1.9.2017 - Mitglied der acatech - Deutsche Akademie der Technikwissen- - Mitglied im Programmkomitee der Teilkonferenz “IT-Sicherheit für schaften e.V., München und Berlin - Sprecher Themennetzwerk Sicherheit, acatech - Deutsche Akademie Kritische Infrastrukturen” der Multikonferenz Wirtschaftsinformatik 2018, Lüneburg, 6.-9.3.2018 der Technikwissenschaften e.V., München und Berlin (bis 07/17) - Mitglied im Programmausschuss Forum Bildverarbeitung 2018 - Stellvertretender Sprecher Themennetzwerk Sicherheit, acatech – Deutsche Akademie der Technikwissenschaften e.v., München und Berlin (ab 08/17) - Leitung der Arbeitsgruppe Lebensfeindliche Umgebungen, Lernende Systeme – Die Plattform für Künstliche Intelligenz - Mitglied im wissenschaftlichen Beirat der Zeitschrift at – Auto- matisierungstechnik der GMA (VDI/VDE-Gesellschaft Mess- und Automatisierungstechnik) und der NAMUR (Interessengemeinschaft Prozessleittechnik der chemischen und pharmazeutischen Industrie) - Member of IEEE Computer Society (International Forum on Image Processing 2018), Karlsruhe, 29.-30.11.2018 - General Chair der 4th International Conference on Optical Characterization of Materials (OCM 2019), Karlsruhe, 13.-14.3.2019 Bier, C.: - Mitglied im DIN-Gremium DIN NIA AK 27-05 Identitätsmanagement und Datenschutz-Technologie 1 3 5

138

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN Boldt, M.: - Session Chair, SPIE Europe Remote Sensing 2016, Conference: Eberle, B.: - Mitglied der NATO-Gruppe SCI-264 »High Energy Laser Weapons: »Earth Resources and Environmental Remote Sensing / GIS Appli- cations«, Sessions: »Processing Methodologies I« und »Processing Methodologies II« - Conference Committee Member, SPIE Europe Remote Sensing 2016 und 2017, Conference: Earth Resources and Environmental Remote Sensing / GIS Applications« Tactical Employment in the Shared Battlespace« - Mitglied der NATO-Gruppe SCI-302 »DRICM Concepts & Performances« - Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« - Vorsitzender der NATO-Gruppe SET-249 »Laser Eye Dazzle–Threat Evaluation and Impact on Human Performance« - Session Chair, SPIE Europe Remote Sensing 2017, Conference: - Vorsitzender der NATO-Gruppe SET-198 »Earth Resources and Environmental Remote Sensing / GIS Applications«, Sessions: »Infrastructures and Urban Areas« und »Processing Methodologies I« Bretschneider, P.: - Stellvertretender Sprecher Fraunhofer-Allianz Energie - Mitarbeit im BDI-Arbeitskreis »Internet der Energie« - Vorstandsmitglied im Thüringer Erneuerbaren Energie Netzwerk (ThEEN) - Mitglied im BMWi-Forschungsnetzwerk Energie (Digitalisierung, Stromnetze) - Mitarbeit im RIS-3 Arbeitskreis Bürsing, H.: - Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« - Conference Chair, »SPIE – Defence & Security Europe« Bulatov, D.: - Reviewer »Photogrammetrie – Fernerkundung – Geoinformation (PFG)« - Reviewer »ISPRS-Journal of Photogrammetry« Burke, J.: - Editor, Advanced Optical Technologies - Program Commitee: Forum Bildverarbeitung 2016 - Chair / Editor, SPIE Interferometry 2016 / 2017 - Program Commitee: Deutsche Gesellschaft für angewandte Optik 2016 / 2017 Carmer von, C.F.: - Mitglied in der NATO-SET-211 Gruppe »Naval Platform Protection in the EO / IR Domain« - Mitarbeit CSSM WG 3 an Overall Ship Signature Management DEU, NLD, CAN, NOR, BEL - Mitglied VDI, AIAA, IAHR Dimmeler, A.: - Mitglied der NATO-Gruppe SCI-ET-035 »EO-IR Countermeasures« - Mitglied der NATO-Gruppe SCI-282 »Countermeasures against »Visible Laser Dazzle–Effects and Protection« Ebert, R.: - Co-Chair Symposium SPIE Security and Defence Europe, Schottland, Edinburgh, 26.-29.9.2016 - Member of the Program Committee SET-241 »09th Military Sensing Symposium«, Kanada, Quebec, 29.5.-2.6.2017 - Co-Chair Symposium SPIE Security and Defence Europe, Polen, Warschau, 11.-17.9.2017 - Mitglied des NATO SET Panel - Mitglied der Optical Society (OSA) Eck, R.: - Mitglied im Fachbereich 2 »Dienste und Anwendungen« der Informationstechnischen Gesellschaft (ITG) im VDE Eisele, C.: - Mitglied der NATO-SET-211 Gruppe »Naval Platform Protection in the EO / IR Domain« - Mitwirkung in der EDA-Arbeitsgruppe ALWS »Airborne Platform Effects On Laser Systems And Electro-Optical Warning Sensors« - Session Chair »Optics in Atmospheric Propagation and Adaptive Systems«, Polen, Warschau, 11.-14.9.2017 - Guest Editor für eine Special Section des Journal of Applied Remote Sensing »Optics in Atmospheric Propagation and Adaptive Systems« - Mitglied der DPG Essendorfer, B.: - Mitglied im STANAG 4559 Custodian Support Team (CST) Fischer, Y.: - Mitglied Technical Program Committee »CogSIMA« - Tutorial Co-Chair Fusion Conference 2017 Flatt, H.: - Program Committee: »International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation« - Co-Chair: »IEEE International Conference on Emerging Technologies and Factory Automation« Anti Aircraft EO / IR Imaging Seeker Threats« - Program Committee: »International Science Conference Computer - Mitglied der NATO-Gruppe SCI-302 »DRICM Concepts & Performances« - Mitglied der NATO-Gruppe SET-240 »Exploitation of Longwave Infrared Airborne Hyperspectral Data« Networks« - ZIM-Netzwerk »Optische Messtechnik & Sensorik für Industrie 4.0«, Vertreter des IOSB-INA 1 3 6

139

Geisler, J.: - Vorstand Carl-Cranz-Gesellschaft - Mitglied im Panel für Systems, Concepts and Integration (SCI) Hammer, H.: - Reviewer »Geoscience and Remote Sensing Letters (GRSL)« - DEU-ISR Kooperation TA 29 (»Visual Processing, Multi Sensor Fusion der NATO-STO and Exploitation for ISR Applications«) - Leiter der NATO-STO Research Task Group SCI-280 on - Session Chair, SPIE Europe Remote Sensing 2017, Conference: »System-of-systems approach to task driven sensor resource management for maritime situational awareness« »Earth Resources and Environmental Remote Sensing / GIS Applications«, Session: »Processing Methodologies III« Gladysz, S.: - Mitglied in der NATO-SET-226 Gruppe »Turbulence mitigation for Heizmann, M.: - Leitung des Fachausschusses 8.12 »Bildverarbeitung in der Electro Optics (EO) and laser systems« - Gasteditor, Journal of Applied Remote Sensing Special Section on Optics in Atmospheric Propagation and Adaptive Systems - Program Committee »Propagation through and Characterization of Atmospheric and Oceanic Phenomena« 25.-29.6.2017, San Francisco - Chairman Conference SPIE Remote Sensing »Optics in Atmospheric Propagation and Adaptive Systems«, Polen, Warschau, 10.-15.9.2017 - Gasteditor, Optical Engineering Special Section on Long-Range Imaging - Reviewer for Optics Express, Applied Optics and Journal of the Optical Society of America - Reviewer for the Irish Research Council and the US Air Force Office of Scientific Research Mess- und Automatisierungstechnik« der VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) - Mitarbeit in der Arbeitsgruppe »Fertigungsmesstechnik 2020« der VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) - Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- Allianz Vision - Leitung des Arbeitskreises »Oberflächeninspektion« am Fraunhofer IOSB - Leitung des Fachausschusses 1.10 »Grundlagen der Messsysteme« der VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) - Mitglied des Fachbeirats des Fachbereichs 1 »Grundlagen und Methoden der Mess- und Automatisierungstechnik« der VDI / VDE- Gesellschaft Mess- und Automatisierungstechnik (GMA) - Stellvertretender Vorsitzender des Fachbeirats des Fachbereichs 3 Göhler, B.: - Mitglied der NATO-Gruppe SET-205 »Active Electro-Optic Sensing »Fertigungsmesstechnik« der VDI / VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) for Target Identification and Tactical Applications« - Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Compressive Sensing for EO / IR Systems« Groß, W.: - DEU-CHE Kooperation TV 03 »Hyperspectral Imaging« - DEU-ISR Kooperation TA 29 »Visual Processing, Multi Sensor Fusion and Exploitation for ISR Applications« Working Group IV »Hyperspectral Remote Sensing Technologies« - Reviewer »IEEE Geoscience and Remote Sensing Letters« Gruna, R.: - Mitglied im Programmausschuss »3rd International Conference on Optical Characterization of Materials« (OCM 2017) - Associate Editor »2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems« (MFI 2017) Haas, C.: - Mitglied im Fachbeirat der Tagung »IT-Sicherheit industrieller Anlagen« Häufel, G.: - Session Chair, SPIE Europe Remote Sensing 2016, Conference: »Earth Resources and Environmental Remote Sensing / GIS Applica- tions«, Session »Infrastructures and Urban Areas« - Session Chair, SPIE Europe Remote Sensing 2017, Conference: »Earth Resources and Environmental Remote Sensing / GIS Applica- tions«, Session »Environmental Monitoring IVI« - Mitglied im wissenschaftlichen Beirat des Kooperativen Promotions- kollegs »Entwurf und Architektur Eingebetteter Systeme (EAES)« der Hochschule Pforzheim und der Universität Tübingen - Mitglied im Wissenschaftlichen Beirat der Zeitschrift tm–Technisches Messen, Verlag De Gruyter, Berlin Jacobi, M.: - Vertreter des IOSB-AST (bis Ende 2016) im ZIM-Netzwerk Mini-ROV Jasperneite, J.: - Evaluator in EU Horizon 2020 SME - Secretary IEEE Industrial Electronics Society, Factory Automation - Co-Chair des Subcommittee on »Information Technology in Industrial and Factory Automation« (IES FA 5) in der IEEE Industrial Electronics Society - Fachredaktion der ATP - Mitglied GMA-Fachausschuss 5.12 Echtzeitsysteme - Mitglied GMA-Fachausschuss 6.15 Zuverlässiger Betrieb Prof. Ethernet-basierter Bussysteme in der industriellen Automatisierung - Mitglied GMA-Fachausschuss 7.21 »Industrie 4.0«-Begriffe, Referenzmodelle, Architekturkonzepte - Vorstandmitglied OWL-Maschinenbau - Stellvertretender Sprecher der Fraunhofer-Allianz Embedded Systems - Mitglied TuLAUT , Theorie und Lehre in der Automatisierungstechnik - IEEE Senior Member - Mitglied Plattform Industrie 4.0, AG 3 »Forschung & Innovation« - Gutachter Österreichische Forschungsförderungsgesellschaft (FFG) - Gutachter Stiftung Rheinland-Pfalz für Innovation - Gutachter Programm ZAFH, Baden-Württemberg 1 3 7

140

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN - Vorstand Internationales Promotionskolleg »Intelligente Systeme in - Gutachter des internationalen Journals »Computers and electronics der Automatisierungstechnik (ISA)« in agriculture: COMPAG« - Führungskreis Industrie 4.0, SG3 | ZVEI – Zentralverband Elektro- technik und Elektroindustrie - Gutachter beim Helmholtz-Validierungsfonds (HVF) - Gutachter für Projekte des Bundesministeriums für Bildung und Kaufmann, I.: - Mitglied der NATO-Gruppe SCI-241 »Defence against UAV Attacks« - Mitglied der NATO-Gruppe SET-238 »Side-Attack Threat Detection Strategies, Technologies and Techniques« Kerth, C.: - Mitglied im STANAG 4559 Custodian Support Team (CST) - Mitglied im OGC Open Geospatial Consortium Kharboutli, S.: - Mitarbeit im EBC Annex 67 »Energy Flexibility in Buildings« Klotz, P.: - Mitglied im STANAG 4559 Custodian Support Team (CST) - Mitglied im IOSB Arbeitskreis Security / Sicherheit Forschung (BMBF) Lenz, A.: - DEU - CHE Kooperation TV 03 »Hyperspectral Imaging« Li, P.: - Mitglied der Studiengangkommission Ingenieurinformatik - Mitglied der Studiengangkommission Computers and Systems Engineering - Mitglied der Stipendienkommission der chinesischen Regierung für chinesische Studenten - Beauftragter vom Rektor für den wissenschaftlichen Austausch China-Südasien Löbnitz, W.: - Vertreter des IOSB-AST (ab 2017) im ZIM-Netzwerk Mini-ROV Körber, M.: - Mitglied der NATO-Gruppe SET-249 »Laser Eye Dazzle–Threat Lutzmann, P.: - Mitglied der NATO-Gruppe SET-205 »Active Electro-Optic Sensing Evaluation and Impact on Human Performance« for Target Identification and Tactical Applications« - Mitglied der NATO-Gruppe SET-198 »Visible Laser Dazzle–Effects - Mitglied der NATO Gruppe SET-219 »Simulation of Active Imaging and Protection« Systems« Kreißl, R.: - Vertreter des Fraunhofer IOSB-AST in der EDNA (Bundesverband Energiemarkt und Kommunikation) Kuny, S.: - Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung Meidow, J.: - Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung e.V. (DAGM) - Mitglied im VDI - Reviewer »Photogrammetrie – Fernerkundung – Geoinformation (PFG)« e.V. (DAGM) - Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing« - Reviewer »ISPRS Congress 2016« - Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing« Längle, T.: - Paritätische Kommission zum Leistungsentgelt am Fraunhofer IOSB - Leitung des Arbeitskreises »Multispektral« am Fraunhofer IOSB - Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- Meyer, J.: - Mitglied im Programmausschuss »3rd International Conference on Optical Characterization of Materials« (OCM 2017) - Gutachter des »Journal of Applied Remote Sensing« Allianz Vision - Vertretung des Fraunhofer IOSB beim SpectroNet International Collaboration Cluster Michaelsen, E.: - Chair IAPR-TC7 (International Association for Pattern - Organisatorische Leitung und Mitarbeit im Programmausschuss des Recognition-Technical Committee 7, Remote Sensing and Mapping) »Forum Bildverarbeitung 2016« - Associate Editor, Pattern Recognition Letters, Elsevier Verlag - Gutachter und Mitglied im Programmkomitee IEEE MFI 2016 - Mitglied im Programmkomitee »SPIE Optical Metrology 2017« - Vorsitzender im Programmausschuss und organisatorische Leitung »3rd International Conference on Optical Characterization of Materials« (OCM 2017) - Gutachter und Mitglied im Programmkomitee »Ilmenau Scientific Colloquium 2017- Engineering for a Changing World« - Mitglied im Verein Deutscher Ingenieure (VDI) - Gutachter der Fachzeitschrift »tm-Technisches Messen« Middelmann, W.: - DEU - CHE Kooperation TV 03 »Hyperspectral Imaging« Müller, W.: - Mitglied in der Gesellschaft für Informatik e.V. (GI) Bonn - Mitglied in der NATO Imagery Working Group 1 3 8

141

Münch, D.: - Program Committee: SPIE Security + Defence 2016, Optics and Richter, M.: - Mitglied im Programmausschuss »3rd International Conference on Photonics for Counterterrorism, Crime Fighting, and Defence Optical Characterization of Materials« (OCM 2017) - Program Committee: SPIE Security + Defence 2017, Optics and Photonics for Counterterrorism, Crime Fighting, Forensics and Surveillance Nicolai, S.: - Vertreter des IOSB-AST im ThEEN AG »Energiespeicher« - Leitung des Arbeitskreises ThEEN AG »Gebäude- und Energietechnik« - Mitarbeit im Forschungsnetzwerk Energie Stromnetze Niggemann, O.: - Mitglied Cooperation im AutomationML Gremium - Mitglied GMA Fachausschuss 7.20 Cyber-physical Systems - Mitglied GMA-Fachausschuss 5.58 Middleware - Sprecher Internationales Promotionskolleg »Intelligente Systeme in der Automatisierungstechnik« (ISA) Ritt, G.: - Mitglied der NATO-Gruppe SET-249 »Laser Eye Dazzle-Threat Evaluation and Impact on Human Performance« - Mitglied der NATO-Gruppe SET-198 »Visible Laser Dazzle-Effects and Protection« Rodrigues, P.: - Beauftragter Thema Demonstrieren, Digital in NRW. Das Kompetenz- zentrum für den Mittelstand in NRW Röcker, C.: - Mitglied Australian Research Council (ARC) - Mitglied Luxembourg National Research Fund (FNR) - Mitglied IEEE Technical Committee on Industrial Automated - Mitglied TuLAUT, Theorie und Lehre in der Automatisierungstechnik Systems and Control Paunescu, G.: - Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Compressive Sensing for EO / IR Systems« - Mitglied InnovationsZentrum für Internettechnologie und Multimediakompetenz, InnoZent OWL e. V. - Vorstand Internationales Promotionskolleg »Intelligente Systeme in der Automatisierungstechnik (ISA)« - Mitglied Nationale Plattform Elektromobilität (NPE) Peinsipp-Byma, E.: - Mitglied Gesellschaft für Informatik - Reviewer der Zeitschrift »at-Automatisierungstechnik« Roller, W. - Mitglied Bitkom Arbeitskreis »Learning Solutions« Pethig, F.: - Mitglied Plattform Industrie 4.0, AG 1 Sander, J.: - Mitglied im »Technical Programm Commitee« der 19th International »Referenzmodelle, Standardisierung & Normung«, UAG Ontologie Conference on Information Fusion (FUSION 2016) Pfützenreuter, T.: - Vertreter des IOSB-AST in der Gesellschaft für Maritime Technik e.V. - Vertreter des IOSB-AST im Subsea Monitoring Network - Mitglied im »Technical Programm Commitee« der 20th International Conference on Information Fusion (FUSION 2017) - Mitglied im Program Committee »20th World Multi-Conference on Systemics, Cybernetics and Informatics« (WMSCI 2017) Rauschenbach, T.: - Mitglied des VDI / VDE GMA-Fachausschuss 5.14 »Computational Intelligence« - Mitglied der Gesellschaft für Maritime Technik (GMT) - Mitglied im VDE - Mitglied Fraunhofer Allianz SysWasser - Mitglied der Foren bei German Water Partnership (Länderforen China und Vietnam) - Mitglied in Deep Sea Mining Alliance Renkewitz, H.: - Vertreter des IOSB-AST im Subsea@Fraunhofer Netzwerk Repasi, E.: - Mitglied der NATO Gruppe SET-219 »Simulation of Active Imaging Systems« Sauer, O.: - Mitglied im Interdisziplinären Gremium Digitalisierung‘ des VDI. - Leitung des VDI-GPL-Richtlinienausschusses »Digitaler Fabrikbetrieb« - Mitglied im VDI-GPL-Fachausschuss »Digitale Fabrik« - Mitglied im VDI-GPP-Fachausschuss »MES« - Mitglied des VDI-GPP-Richtlinienausschusses »Logische Schnittstelle MES-Maschine« - Mitglied in der VDA-ITA »Informationstechnologie für die Automobilindustrie« - Mitglied im CIRP »STC »O« Optimization of Manufacturing Systems« - Mitglied in der »OPC Foundation« - Mitglied des Automotive Engineering Netzwerks Südwest - Vorstand Wirtschaftsstiftung Südwest - Mitglied im VDI-Fachausschuss Modellierung und Simulation - Mitglied im Fachbeirat Digitale Fabrik@Produktion - Erstansprechpartner des IOSB in der Innovationsallianz der - Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Technologieregion Karlsruhe Compressive Sensing for EO / IR Systems« 1 3 9

142

N A M E S , D A T E S , E V E N T S N A M E N , D A T E N , E R E I G N I S S E PARTICIPATION IN COMMITTEES MITARBEIT IN GREMIEN Scharaw, B.: - Head of Section Central Asia, GWP - Mitglied des wissenschaftlichen Rates der Deutsch-Mongolischen Schwegmann, A.: - Mitglied der NATO-SCI-284 Gruppe »Assessment Methods for Camouflage in Operational Context « Gesellschaft - Mitglied im Kharaa River Basin Administration Schönbein, R.: - Mitglied der Deutschen Gesellschaft für Wehrtechnik e.V., Bonn - Mitglied der Human Factors and Ergonomics Society, USA, Santa Monica, Kalifornien Schweitzer, C.: - Mitglied in der NATO-SCI-279 Gruppe »Enabling Technical Conside- rations for a NATO-Common Space Domain Operating Picture« - Mitglied in der NATO-SCI-283 Gruppe »Considerations for Space and Space-Enabled Capabilities in NATO Coalition Operations« - Mitglied in der NATO-SCI-285 Gruppe »Space Domain Effects on - Mitglied im Fachausschuss T 5.4 Anthropotechnik; Deutsche NATO Operations« Gesellschaft für Luft- und Raumfahrt (DGLR) - Vertretung des IOSB in der Fraunhofer-Allianz Space - Mitglied im editorial board of the International Journal on Advances in Systems and Measurements (IARIA Journals) - Mitglied im Programmausschuss ICONS Seiffer, D.: - Mitglied in der NATO-SET-234 Gruppe »Environmental limitations Schriegel, S.: - Profibus International-PNIO-AK TSN Schulte, H.: - Vertretung des Fraunhofer IOSB im Arbeitskreis der Fraunhofer- Allianz Food Chain Management (FCM) - Mitglied im Programmausschuss »3rd International Conference on Optical Characterization of Materials« (OCM 2017) Schulz, K.: - Conference Chair, SPIE Europe Remote Sensing 2016 und 2017, Conference: Earth Resources and Environmental Remote Sensing / GIS Applications - Session Chair, SPIE Europe Remote Sensing 2016, Conference: Earth Resources and Environmental Remote Sensing / GIS Appli- cations, Sessions: »Sensors and Platforms« und »Environmental Monitoring Concepts IV« - Session Chair, SPIE Europe Remote Sensing 2017, Conference: Earth Resources and Environmental Remote Sensing / GIS Appli- cations, Sessions: »Environmental Monitoring I« und »Processing Methodologies II« - DEU - ISR Kooperation TA 29 »Visual Processing, Multi Sensor Fusion and Exploitation for ISR Applications« Working Group IV »Hyperspectral Remote Sensing Technologies« - Member of IEEE Geoscience and Remote Sensing Society - Mitglied NATO-RTO-SCI-248 »Vulnerability of NATO operations of fielded EO-TDAs« - Deutscher Vertreter in der EDA-Arbeitsgruppe ALWS »Airborne Plat- form Effects On Laser Systems And Electro-Optical Warning Sensors« - Member of Program Committee, »Technologies for Optical Countermeasures« bei der SPIE Security + Defence Sprung, D.: - Mitwirkung in der Kooperation mit dem Kiepenheuer-Institut für Solarphysik (KIS), Freiburg, »Bestimmung der optischen Turbulenz am Observatorium VTT auf dem Teide / Teneriffa, Spanien« - Mitwirkung in der deutsch-israelischen Arbeitsgruppe mit dem Soreq / Israel »Wind and turbulence measurements« - Mitwirkung in der deutsch-südafrikanischen Kooperation mit dem SCIR Südafrika zu »Determination of the vertical distribution of optical turbulence over savannah« - Reviewer for Optical Engineering, Applied Optics and Journal of the Optical Society of America A (OSA) - Kooperation mit dem ISL / Frankreich, Betreuung einer Doktorarbeit (2017) - Mitwirkung Projekt EORAD, Kooperation mit Universität Delft / NL (Sukanta Basu, S. Gladysz D. Sprung, I. Toselli, K. Stein) Stein, K.: - Chairman Conference SPIE Remote Sensing, »Optics in Atmospheric Propagation and Adaptive Systems« Warschau, 10.-15.9.2017 - Chairman Conference SPIE Security & Defence, »Target and Background Signatures«, Warschau, 10.-15.9.2017 to current and future commercial space-based Synthetic Aperture Radar (SAR) sensors« - Chairman Conference SPIE Remonte Sensing »Optics in Atmospheric Propagation and Adaptive Systems«, Edinburgh, 25.-29.9.2016 - Mitglied NATO-RTO-SET-220 »Geospatial Information Extraction - Chairman Conference SPIE Security & Defence, »Target and From space-Borne SAR-Images for NATO-Operations« - Reviewer »Journal of at - Automatisierungstechnik« - Reviewer »Deutsche Forschungsgemeinschaft (DFG)« Schwarz, A.: - Mitglied in der NATO SET-ET-096 Gruppe »Smart Textiles, Wearables and Sensors for the Integration of Soldier / System Capabilities« - Leitung CCG-Kurs »Signaturmanagement« SE 2.14 Background Signatures«, Warschau, Edinburgh, 25.-29.9.2016 - Mitglied der NATO-SET-211 Gruppe »Naval Platform Protection in the EO / IR Domain« - Mitglied in der NATO-SCI-ET-013 Gruppe »Evaluation Methods and Assessment of Camouflage in Operational Context« - Chairman in der NATO-SCI-ET-017 Gruppe »Development of Methods for Measurements and Evaluation of Natural Background Colours« - Mitglied in der NATO-SCI-283 Gruppe »Considerations for Space and Space-Enabled Capabilities in NATO Coalition Operations« 1 4 0

143

- Mitglied der NATO-SCI-284 Gruppe »Assessment Methods for Camouflage in Operational Context« - Mitglied der NATO-SCI-291 Gruppe »Scenarios for Assessment Methods for Camouflage in Operational Contexts« - Mitglied der NATO-SCI-295 Gruppe »Development of Methods for Measurements and Evaluation of Natural Background EO Signatures« - SCI-Panel, Member at Large - Leitung Kurs »Warnsensorik« SE 3.11 der Carl-Cranz-Gesellschaft e.V. Stricker, R.: - Mitglied der Studienkommission des Fachbereichs Informatik an der Hochschule Zittau-Görlitz Taphanel, M.: - Mitglied im Programmausschuss »3rd International Conference on Optical Characterization of Materials« (OCM 2017) - Mitglied der Deutsche Physikalische Gesellschaft (DPG) Tchouchenkov, I.: - Mitglied GMA-Fachausschusses 5.15 »Agentensysteme« Thiele, A.: - Reviewer »Photogrammetrie – Fernerkundung – Geoinformation (PFG)« - Reviewer »ISPRS Journal of Photogrammetry and Remote Sensing« Usländer, T.: - Co-Chair der Session »Resilience: Methods, Tools and Indications« der IDRC, Schweiz Westermann, D.: - Mitglied im CIGRE National Committee Germany - Mitglied im CIGRE DAK C2 – System Operation - Mitglied in CENELEC TC 8X/WG 06 – System Aspects of HVDC Grids - Mitglied in IEC UK 121.1 – Short Circuit Current Calcuation for HVDC Grids - Mitglied in IEEE WG on »Practical Technologies for VSC HVDC Systems« / IEEE WG on »Planning for HVDC« - Leitung der IEEE Energy Development and Power Generation, Industry Practice Subcommittee, WG Europe (HVDC Panel @ GM) - Mitglied IEEE Germany Section »Industry Relation Officer« - Mitglied IEEE PES Germany Chapter »Treasurer« - Sprecher der RIS 3 Arbeitsgruppe »Energie und Ressourceneffizienz« – Freistaat Thüringen - Mitglied im FNN Lenkungskreis HS-HoeS Netze - Reguläres Mitglied in der Sächsischen Akademie der Wissenschaften, Technikwissenschaftliche Klasse - Mitglied im PTJ Forschungsnetzwerk Energie – Stromnetze - Mitglied im wissenschaftlicher Beirat 50Hertz Transmission GmbH - Mitglied Direktorium Institut für Energiewirtschaftsrecht an der FSU Jena - Mitglied im wissenschaftlicher Beirat Energiecampus Nürnberg - Mitglied in der Scientific Reference Group »ProMotion« - Direktor des Instituts für Elektrische Energie- und Steuerungstechnik - Leiter Studiengangskommission Masterstudiengang »Elektric Power and Control Engineering« - Mitglied Studiengangskommission Diplomstudiengang Elektrotechnik und Informationstechnik - Vorsitzender Prüfungsausschuss Elektrotechnik und Informations- - Mitglied im Advisory Board der Digital Innovation Group technik - Vorsitzender Prüfungsausschuss Electrical Power and Control Engineering Willersinn, D.: - Mitglied des wissenschaftlichen Beirats des Heidelberger Bildverarbeitungsforums Winkelmann, M.: - Deutscher Vertreter in der Arbeitsgruppe »Multispectral Camouflage Concealment and Deception« der deutsch-israelischen Kooperation - Mitglied in der NATO-SCI-270 Gruppe »Process Development for D&D Field Trials and Associated Data Analysis« - Mitglied der NATO-SCI-295 Gruppe »Development of Methods for Measurements and Evaluation of Natural Background EO Signatures« Wagner, B.: - Mitglied in der DGfK (Deutsche Gesellschaft für Kartographie e.V.) - Mitglied im OGC (Open Geospatial Consortium) Warweg, O.: - Mitarbeit im VDE / ITG Energieinformationsnetze - Mitglied VDE Arbeitskreis Smart Grids - Mitarbeit und Vertreter des Fraunhofer IOSB-AST in der Fraunhofer Allianz Big Data - Vertreter des Fraunhofer IOSB-AST in der Fraunhofer Academy - Mitarbeit und Vertreter des IOSB-AST im Netzwerk eMobilityCity - Vertreter des Fraunhofer IOSB-AST in der EDNA (Bundesverband Energiemarkt und Kommunikation) Wegner, D.: - Mitglied der NATO-Gruppe SET-232 »Computational Imaging and Compressive Sensing for EO / IR Systems« Wenzel, A.: - Mitglied Fraunhofer Allianz Embedded - Mitglied VDI / VDE-GMA FA 7.20 Cyber Physical Systems 1 4 1

144

YOU FIND SCIENTIFIC PUBLICATIONS ON THE WEB. ABSTRACTS AND WHOLE TEXTS: www.iosb.fraunhofer.de > Publications WISSENSCHAFTLICHE VERÖFFENTLICHUNGEN FINDEN SIE IM WEB. ABSTRACTS UND VOLLTEXTE UNTER: www.iosb.fraunhofer.de > Publikationen TEACHING ACTIVITIES LEHRTÄTIGKEITEN Arens, M.: - Einführung in die Bildfolgenauswertung, SS 2016, SS 2017 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Atorf, D.; Berger, A.: - Praxis der Softwareentwicklung, SS 2017 - Lehrveranstaltung in Kooperation mit dem Lehrstuhl Programmier- paradigmen für die Fachrichtung Informatik zur Entwicklung eines mittelgroßen Systems im Team mit Objektorientierter Software- technik, hier: Entwicklung eines Prototyps zu Crayons 2.0 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Beyerer, J.: - Mustererkennung, SS 2017, SS 2018 - Automatische Sichtprüfung und Bildverarbeitung, WS 2016/2017, WS 2017/2018 - Seminar: Technologiegestütztes Lernen, SS 2017 - Seminar: Bildauswertung und -fusion, SS 2017 - Proseminar: Anthropomatik: Von der Theorie zur Anwendung, SS 2017, WS 2017/2018 (gemeinsam mit Prof. Uwe Hanebeck) - Projektpraktikum Bildauswertung und -fusion, WS 2017/2018 - Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Bretschneider, P.: - Energieprognose im Rahmen der SS-Vorlesung von Professor Westermann, Elektrische Energieversorgung ESIII, SS 2016 - Energieeinsatzoptimierung - Grundlagen, SS 2017 - Energieeinsatzoptimierung - Multimodale Energiesysteme, WS 2017 Fakultät für Elektrotechnik und Informationstechnik, Technische Universität Ilmenau Dutschk, B.; Uhlig, D.; Heizmann, M.: - Praktikum Mechatronische Messsysteme, SS 2017 Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT) Flatt, H.: - Embedded Systems Design, WS 2017/18 Fachbereich Elektrotechnik und Technische Informatik, Hochschule Ostwestfalen-Lippe, Lemgo Geisler, J.: - Mensch-Maschine-Wechselwirkung in der Anthropomatik: Basiswis- sen, WS 2016/2017 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Heizmann, M.: - Verteilte Messsysteme, 23.-27.5.2016, Blockveranstaltung am Chi- nesisch-Deutschen Hochschulkolleg (CDHK) der Tongji-Universität, Shanghai, China - Fertigungsmesstechnik, SS 2016, SS 2017 - Messtechnik in der Mechatronik, WS 2016/2017 - Informationsfusion, WS 2016/2017 Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT) 1 4 2 Jasperneite, J.: - Rechnernetze, SS 2017 - CDS (IT-Master), SS 2017 - Protocol Engineering (VP-RN), WS 2017/18 - Weitverkehrsnetze, WS 2017/18 - Maschinennahe Vernetzung, WS 2017/18 - TechStartup, WS 2017/18 Fachbereich Elektrotechnik und Technische Informatik, Hochschule Ostwestfalen-Lippe, Lemgo Kannegieser, E.; Atorf, D.; Streicher, A.: - Seminar zum Technologiegestützten Lernen (TGL), SS 2016, SS 2017 Seminar in Kooperation mit dem Forschungszentrum Informatik (FZI), der Hochschule Karlsruhe für Technik und Wirtschaft (HsKa) und dem Institut für Berufspädagogik (KIT/IBP) für die Fachrichtungen Informatik, Informationswirtschaft und Wirtschaftswissenschaften, Fakultät für Wirtschaftswissenschaften und Fakultät für Geistes- und Sozialwissenschaften, Karlsruher Institut für Technologie (KIT) Längle, T.: - Projektpraktikum Robotik und Automation I+II, SS 2016 - Echtzeitsysteme, SS 2016 - Projektpraktikum Robotik und Automation I+II, WS 2016/2017 - Einführung in die Informatik für Naturwissenschaftler und Ingenieure I, WS 2016/2017 Projektpraktikum Robotik und Automation I+II, SS 2017 - Projektpraktikum Robotik und Automation I+II, WS 2017/2018 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) - Kognitive Systeme, WS 2016/2017 - Kognitive Systeme, WS 2017/2018 Duale Hochschule Baden-Württemberg (DHBW) Karlsruhe Li, P.: - Control Engineering, WS 2015/16, WS 2016/17, WS 2017/18 - Regelungs- und Systemtechnik 2, WS 2015/16, WS 2016/17, WS 2017/18 - Prozess- und Umweltsystemtechnik, WS 2015/16, WS 2016/17, WS 2017/18 - Regelungs- und Systemtechnik 1, SS 2016, SS 2017 - Regelungs- und Systemtechnik 3, SS 2016, SS 2017 - Dynamische Prozessoptimierung, SS 2016, SS 2017 - Prozessoptimierung 1, SS 2016, SS 2017 Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Maier, A.: - Algorithmen und Datenstrukturen, WS 2017/18 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo

145

Meidow, J.: - Bildsequenzanalyse, WS 2016/2017 Fakultät für Bauingenieur-, Geo- und Umweltwissenschaften, Karlsruher Institut für Technologie (KIT) Niggemann, O.: - Machine Learnig, WS 2017/18 - Algorithms and Data Structures, WS 2017/18 - Theoretical Computer Science, WS 2017/18 - The Art of Written and Oral Presentations, SS 2017 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo Pak, A.: - Bilddatenkompression, WS 2016/17 Scharaw, B.: - Integrated Urban water management, 10.-12.3.2016, 14.- 16.6.2016, 20 -23.9.2016 Technology Mongolian University of Science and Technology, Faculty of Construction and Water - China Agricultural University in Hohhot (China), 08.-12.8.2016 Hydrology Institute in Ilmenau - Ground water management, 27.-28.2.2017 China Agricultural University in Hohhot (China), Hydrology Institute in Ilmenau Wenzel, A.: - Embedded Systems, WS 2015/16, WS 2016/17, WS 2017/18 - Mikrocontrollertechnik, WS 2015/16, WS 2016/17, WS 2017/18 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) - Mikroprozessortechnik, SS 2016, SS 2017 Fakultät für Elektrotechnik, Hochschule Schmalkalden Peinsipp-Byma, E.; Sauer, O.: - Gestaltungsgrundsätze für Interaktive Echtzeitsysteme, SS 2016, SS 2017 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Pieper, C.: - Hardware eingebetteter Systeme, SS 2017 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo Rauschenbach, T.: - Diagnose- und Vorhersagesysteme, WS 2015/16, WS 2016/17, WS 2017/18 Technische Universität Ilmenau, Fakultät für Informatik und Automatisierung Röcker, C.: - Vorlesung Verteilte Systeme, SS 2017 - Übung Verteilte Systeme, SS 2017 - Vorlesung Mensch-Maschine-Interkation, SS 2017 - Übung Mensch-Maschine-Interkation, SS 2017 - Vorlesung Rechnerorganisation und Betriebssysteme, WS 2017/18 - Übung Rechnerorganisation und Betriebssysteme, WS 2017/18 - Vorlesung Usability Engineering, WS 2017/18 - Übung Usability Engineering, WS 2017/18 - Vorlesung User Experience und Interaction Design, WS 2017/18 - Übung User Experience und Interaction Design, WS 2017/18 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo Ruf, B.: - Grundlagen der Computer Grafik, SS 2016, SS 2017 Fakultät für Technik, Duale Hochschule Baden-Württemberg, Ravensburg Westermann, D.: - Grundlagen der elektrischen Energiesystem- und Anlagentechnik– EPCE, WS 2015/16, WS 2016/17, WS 2017/18 - Grundlagen des Betriebs und Analyse elektrischer Energiesysteme, SS 2016, SS 2017 - Netzleittechnik und Energiemanagementsysteme, SS 2016, SS 2017 - Netzdynamik, HGÜ und FACTS, WS 2015/16, WS 2016/17, WS 2017/18 - Modellbildung und Simulation in der Energietechnik, SS 2016, SS 2017 Fakultät für Elektrotechnik und Informationstechnik, Technische Universität Ilmenau Windmann, S.: - Blockseminar Programmiersprachen 2, SS 2017 - Vorlesung Programmiersprachen 1, WS 2017/18 Institut für industrielle Informationstechnik, Hochschule Ostwestfalen-Lippe, Lemgo Zaschke, C.; Kerth, C.: - Kooperation mit der Forschungsgruppe C&M des KIT, SS 2017 - Betreuung studentischer Arbeiten mit den Themenschwerpunkten Domain-driven Design (DDD) und Microservices in Kooperation mit der Forschungsgruppe Cooperation & Management (C&M) von Herr Prof. Abeck Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) 1 4 3

146

DISSERTATIONS DISSERTATIONEN Aissa, Tarek: Systemidentifikation und Reglersynthese für örtlich verteilte Prozesse durch adaptive Takagi-Sugeno Fuzzy Systeme am Beispiel des Raumklimaverhaltens Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Münch, David: Begriffliche Situationsanalyse aus Videodaten bei unvollständi- ger und fehlerhafter Information Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Belkin, Andrey: World Modeling for Intelligent autonomous Systems Fakultät für Informatik Karlsruher Institut für Technologie (KIT) Birnstill, Pascal: Privacy-Respecting Smart Video Surveillance Based on Usage Control Enforcement Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Petereit, Janko: Adaptive State × Time Lattices: A Contribution to Mobile Robot Motion Planning in Unstructured Dynamic Environments Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Qu, Chengchao: Facial Texture Super-Resolution by Fitting 3D Face Models Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Boldt, Markus: Änderungsanalyse in Zeitreihen hochaufgelöster SAR- Satellitenbilder Fakultät für Bauingenieur-, Geo- und Umweltwissenschaften, Karlsruher Institut für Technologie (KIT) Stephan, Thomas: Beitrag zur Unterwasserbildrestauration Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Grinberg, Michael: Feature-Based Probabilistic Data Association for Video-Based Multi-Object Tracking Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Trommer, Maria: Ein Beitrag zur Anwendung von Support-Vektor-Maschinen zur robusten nichtlinearen Klassifikation komplexer biologischer Daten Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Höfer, Sebastian: Untersuchung diffus spiegelnder Oberflächen mittels Infrarot- deflektometrie Fakultät für Informatik Karlsruher Institut für Technologie Woock, Philipp: Umgebungskartenschätzung aus Sidescan-Sonardaten für ein autonomes Unterwasserfahrzeug Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Janya-anurak, Chettapong: Framework for analysis and identification of nonlinear distributed parameter systems using Bayesian uncertainty quantification based on generalized polynomial chaos Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Krempel, Erik: Steigerung der Akzeptanz von intelligenter Videoüberwachung in öffentlichen Räumen Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Moßgraber, Jürgen: Ein Rahmenwerk für die Architektur von Frühwarnsystemen Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) 1 4 4

147

LECTURES 2016 VORTRÄGE 2016 Adomeit, U.: Grundlagen und neueste Entwicklungen der Nachtsichttechnik. 4. KSK Symposium Rüstung, Wart, 21.9.2016 Adomeit, U.: Verfahren zur Leistungssteigerung von Wärmebildgeräten. Seminar SE 1.02 »Infrarottechnik – Grundlage, Trends und moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 18.10.2016 Adomeit, U.; Schuberth, W.: Thermisches Reichweitenmodell zur Punktzielauffassung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegen- maßnahmen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 17.11.2016 Becker, S.; Scherer-Negenborn, N.; Thakkar, P.; Hübner, W.; Arens, M.: An evaluation of background substraction algotrithms on fused infrared-visible video streams. International Conference on Digital Image Computing: techniques and Applications (DICTA 2015), Australien, Adelaide, 23.-25.11.2015 Becker, S.; Kieritz, H.; Hübner, W.; Arens, M.: On the benefit of state separation for tracking in image space with an interacting multiple model filter. International Conference on Image and Signal Processing (ICISP) 2016, Kanada, Trois-Rivières, 30.5.-1.6.2016 Becker, S.; Krah, S.; Hübner, W.; Arens, M.: MAD for visual tracker fusion. SPIE Security + Defence 2016, UK, Edinburgh, 26.-29.9.2016 Adomeit, U.: IR-Detektorentwicklung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der Carl-Cranz- Gesellschaft e.V., Oberpfaffenhofen, 17.11.2016 Becker, S.; Scherer-Negenborn, N.; Thakkar, P.; Hübner, W.; Arens, M.: The effects of camera jitter for background substraction algorithms on fused infrared-visible video streams. SPIE Security + Defence 2016, UK, Edinburgh, 26.-29.9.2016 Anneken, M.; Fischer, Y.; Beyerer, J.: Anomaly Detection using B-Spline Control Points as Feature Space in Annotated Trajectory Data from the Marine Domain. International Conference on Agents and Artificial Intelligence, Italien, Rom, 24.-26.2.2016 Bergmann, S.; Mohammadikaji, M.; Irgenfried, S.; Wörn, H.; Beyerer, J.; Dachsbacher, C.: A Phenomenological Approach to Integrating Gaussian Beam Properties and Speckle into a Physically-Based Renderer. Vision, Modeling, and Visualization 2016, Bayreuth, 12.10.2016 Anneken, M.; Fischer, Y.; Beyerer, J.: Detection of conspicuous behavior in street traffic by using B-Splines as feature vector. 11th Future Security; Berlin, 13.-14.9.2016 Anneken, M.: Detektion von auffälligem Verhalten in räumlich-zeitlichen Datensätzen. Technologie Tag Verteidigung des Fraunhofer IOSB, Karlsruhe, 18.10.2016 Arnoldt, A.; Klarner, T.; Ritter, S.; Warweg, O.: Optimized provision of minute reserve capacity products by controlled charging of electric vehicles. EEM2016-IEEE European Energy Market, Portugal, Porto, 6.-9.6.2016 Azaiez, S.; Boc, M.; Cudennec, L.; Da Silva Simoeasa, M.; Haupert, J.; Kchir, S.; Klinge, X.; Labidi, W.; Hahhal, K.; Pfrommer, J.; Schleipen, M.; Schulz, C.; Tortech, T.: Towards flexibility in Future Industrial Manufacturing: A Global Framework for Self-Organization of Production Cells. RAMCOM 2016, Spanien, Madrid, 23.-25.5.2016 Batz, T.: Co-Design of Requirements and Architectural Artefacts for Industrial Internet Applications. 7th International Symposium on Information Management in a Changing World, Österreich, Wien, 10.-11.10.2016 Bernard, T.: Innovative software platform and sensors for the detection and mitigation of CBRN related contamination events of drinking water (SAFEWATER). Vortrag bei 6th SWAN Conference, UK, London, 6.4.2016 Bernard, T.: Neuartige Sensoren und Software-Tools zu Online-Monitoring, Qualitätsüberwachung und Schadens-minimierung bei CBRN-Kontaminationen in Trinkwasser-netzen (SAFEWATER). ÖVGW-Kongress und Fachmesse Gas Wasser 2016, Österreich, Wels, 21.4.2016 Bernard, T.: On-line Monitoring of Drinking Water Based on a Biological Broad-Spectrum Sensor (AquaBioTox). 1st International Symposium on Mobile Water Supply in Operations: Research and Field Experience Munster, Münster, 7.-9.6.2016 Bernard, T.: SAFEWATER-Innovative tools for the detection and mitigation of CBRN related contamination events of drinking water. Water Innovation Europe 2016 (WIE2016), Belgien, Brüssel, 21.6.2016 Bernard, T.: Cloud-based event detection platform for water distribution net- works using machine-learning algorithms. Konferenz »Machine Learn- ing for Cyber-Physical-Systems«, Fraunhofer IOSB, Karlsruhe, 29.9.2016 1 4 5

148

LECTURES 2016 VORTRÄGE 2016 Bernard, T.: Online Hydraulic and Water Quality Simulator as a Tool for Contamination Event Response. Conference Computing and Control in the Water Industry (CCWI 2016), Niederlande, Amsterdam, 9.11.2016 Beyerer, J.: High-Level Umweltmodelle als Gedächtnisstruktur für die Wahrnehmung intelligenter technischer Systeme. Research Camp der Junior Research Class, Fraunhofer-Gesellschaft, Waischenfeld, 18.-19.8.2016 Bernard, T.: SAFEWATER - Innovative tools for the detection and mitigation of CBRN related contamination events of drinking water. SAFEWATER Final Conference-International Conference on Water Security, Schweiz, Zürich, 23.11.2016 Bernard, T.: SAFEWATER - Innovative tools for the detection and mitigation of CBRN related contamination events of drinking water. Water Safety and Security Workshop der Europäischen Kommission (DG Home), Belgien, Brüssel, 12.12.2016 Beyerer, J.: Viele Augen – Ein Bild – Optronische Sicht und deren technische Nutzung für die Landstreitkräfte der Zukunft. Symposium des Förderkreises Deutsches Heer e.V.: »Forschung und Technologie für die Landstreitkräfte mit Zeithorizont 2030+ - Vom Labor in den Einsatz«, Freiburg, 11.-12.10.2016 Beyerer. J.: Blick in die Fraunhofer-Labore: Das IT-Sicherheitslabor für die industrielle Produktion. Fraunhofer-Tag der Cybersicherheit, »Sicher in die digitale Zukunft«, Berlin, 20.10.2016 Beyer, D.; Ruhe, S.; Bretschneider, P.: Results of a Monte Carlo based Risk Analysis on the Impact of PEVs to the Distribution Grid. IEEE EnergyCon 2016, Belgien, Leuven, 4.-8.4.2016 Beyerer, J.: Maschinelles Lernen für die Überwachung und Optimierung von Produktionsprozessen. Strategische Fokustage Maschinelles Lernen, München, 11.2.2016 Beyerer, J.: Forschungsschwerpunkte beim VVS. Angewandte Forschung für Verteidigung und Sicherheit in Deutschland. Veranstaltung der Studiengesellschaft der DWT MbH in Zusammenarbeit mit BMVg, F&T- Ausschuss des BDSV, Fraunhofer VVS und DLR, Bonn, 23.-25.2.2016 Beyerer, J.: Neue Technologien für die Terrorismusabwehr. Fachveranstaltung der Fraunhofer-Gesellschaft für die deutschen Polizeibehörden. Fraunhofer IOSB, Karlsruhe, 8.3.2016 Beyerer. J.: Geschäftsmodelle für den effektiven und schnellen Technologie- transfer von Fraunhofer in die Polizeibehörden; Formate und Prozesse. Fachveranstaltung der Fraunhofer-Gesellschaft für die deutschen Polizeibehörden. Fraunhofer IOSB, Karlsruhe, 8.3.2016 Beyerer, J.: Videoüberwachung und Mensch-Maschine-Interaktion – Tech- nische und rechtliche Herausforderungen. Jubiläumsfeier des Instituts für Recht und Technik, Erlangen, 1991 – 2016, Kolloquium »Interdisziplinarität«, Universität Erlangen-Nürnberg, 20.-21.5.2016 Beyerer, J.: Welche Information steckt in den Daten? Erfassung, Analyse, Modellierung, Nutzung und Anwendungsbeispiele. 4. VDI Fach- konferenz Big Data Technologien in der Produktion, Ettlingen, 28.6.2016 1 4 6 Beyerer, J.: Autonome Systeme. Fraunhofer Strategie Klausur, Leipzig, 2.-4.11.2016 Beyerer, J.: From Pictures to Semantics – How to Extract Meaning from Image Data. Jenoptik AG, Sindelfingen, 16.11.2016 Bretschneider, P.; Herzog, R.; Bernard, T.; Tippmann, V.; Warweg, O.; Naumann, S.: Mit dem Internet der Dinge vom Gebäude- zum Stadtteil-Energie- management. VDE Kongress 2016, Mannheim, 7.-8.11.2016 Bier, C.; Kühne, K.; Beyerer, J.: PrivacyInsight: The Next Generation Privacy Dashboard. 4th Annual Privacy Forum, APF 2016, Frankfurt a. M., 7.-8.9.2016 Bier, C.: Ansatz zur Berechnung des Linkage-Risikos in Informations- flüssen. Future Security 2016, Berlin, 13.-14.9.2016 Birnstill, P.; Bier, C.; Wagner, P.; Beyerer, J.: Generic Semantics Specification and Processing for Inter-System Information Flow Tracking. 15th International Conference on Security and Management, USA, Las Vegas, Nevada, 25.-28.7.2016 Bodensteiner, C.; Bullinger, S.; Lemaire, S.; Arens, M.: Single frame based video geo-localisation using structure projection. IEEE International Conference on Computer Vision Workshop (ICCVW 2015), Chile, Santiago, 7.-13.12.2015 Boldt, M.; Falge, R.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): Towards the Categorization of Changes at Stuttgart Airport. 11th European Conference on Synthetic Aperture Radar (EUSAR 2016), Hamburg, 6.-9.6.2016

149

Boldt, M.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): An Iterative Approach to Optimize Change Classification in SAR Time Series Data. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 Bretschneider, P.; Bernard, T.; Herzog, R.; Tippmann, V.; Warweg, O.; Naumann, S.: Mit dem Internet der Dinge vom Gebäude- zum Stadtteil-Energie- management. VDE Kongress 2016, Mannheim, 7.-8.11.2016 Bulatov, D.; Häufel, G.; Pohl, M.: Vectorization of road data extracted from aerial and UAV imagery. International Society for Photogrammetry and Remote Sensing (ISPRS 2016), Tschechien, Prag, 12.-19.7.2016 Bulatov, D.; Wayand, I.; Schilling, H.: Automatic tree-crown detection in challenging scenarios. International Society for Photogrammetry and Remote Sensing (ISPRS 2016), Tschechien, Prag, 12.-19.7.2016 Bulatov, D.; Häufel G.; Pohl, M.: Identification and correction of road courses by merging successive segments and using improved attributes. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 Bulatov, D.; Schilling, H.: Segmentation Methods for Detection of Stationary Vehicles in Combined Elevation and Optical Data. 23rd International Confe- rence on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Bulatov, D.; Kottler, B.; Rottensteiner, F. (Leibniz Universität Hannover): Energy Minimization of Discrete Functions with Higher-Order Potentials for Depth Maps Generation. 23rd International Confe- rence on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Bullinger, S.; Bodensteiner C.; Wuttke, S.; Arens, M.: Moving object reconstruction in monocular video data using boundary generation. IEEE 23rd International Conference on Pattern Recognition ICPR 2016, Mexiko, Cancun, 4.-8.12.2016 Burke, J.: Inspection of Reflective Surfaces with Deflectometry. International Conference on Processes in Combined Digital Optical & Imaging Methods applied to Mechanical Engineering, Schweiz, Locarno, 12.5.2016 Burke, J.: Das nimmermüde Auge – automatische Erkennung und Klassifikation von Oberflächendefekten mit Deflektometrie. Fraunhofer Technologietag 2016, Deutschland, Fürth, 19.10.2016 Carmer von, C.F.: IR-Schiffsignaturmanagement. Lehrgangskurs SE2.14 »Radar-, VIS und IR-Signaturen« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 30.11.2016 Denzer, R.; Sutschet, G.: Systematische Betrachtung nicht-funktionaler Anforderungen beim Entwurf von I4.0 Service-Strukturen. Automation 2016, Baden-Baden, 7.-8.6.2016 Eberle, B.: - Laser-Radar: Einfluss der Atmosphäre, operationelle Rand- bedingungen und Potential des Laser-Radars. - Augen- und Sensorschutz gegen Laser-Blendung und Laser- Zerstörung. Lehrgang Lasertechnik, Bildungszentrum der Bundeswehr, Mannheim, 22.4.2016 Eberle, B.: Grundlagen zum Seminarthema Lasergestützte Aufklärung mittels Laser-Radaren. Seminar FA 1.06 »Aufklärung mit moderner Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 31.5.-2.6.2016 Eberle, B.: Schutz vor zukünftigen Laserbedrohungen gegen Laser-Blendung und Laser-Zerstörung. Wehrtechnisches F&T-Symposium »Safety und Security in militärischen Waffensystemen«, Bildungszentrum der Bundeswehr, Mannheim, 14.6.2016 Eberle, B.: Laser-Radarsysteme für Zielaufklärung und Navigation. Seminar SE 2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 16.6.2016 Eberle, B.: Photothermal Effects of Nanoparticles in Liquid Media. 17th International Conference »Laser Optics 2016«, Russland, St. Petersburg, 27.-30.6.2016 Eberle, B.: Schutz vor zukünftigen Laserbedrohungen gegen Laser-Blendung und Laser-Zerstörung. Symposium »Cave Lucem«, Marinekommando Rostock, Rostock, 20.-21.9.2016 Eberle, B.: - Zukünftige passive Infrarot-Sensoren. - Potenzial zukünftiger Laser-Sensoren. Seminar SE 2.31 »Intelligente Sensorik II: Entwicklungspotential und zukünftige Systeme« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 27.10.2016 van de Camp, F.; Gill, D.; Hild, J.; Beyerer, J.: An Analysis of Accuracy Requirements for Automatic Eyetracker Recalibration at Runtime. HCI International 2016, Kanada, Toronto, 17.-22.7.2016 Eberle, B.: Laser-Hinderniswarnung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW)« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 15.11.2016 1 4 7

150

LECTURES 2016 VORTRÄGE 2016 Ebert, R.: Quantum Imaging - ein neues Verfahren für die bildhafte Auf- klärung. DWT-Konferenz: Angewandte Forschung für Verteidigung und Sicherheit, Bonn, 23.-25.2.2016 Ebert, R.: Laser Vibrometry for wind turbines inspections. SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring, USA, Las Vegas, Nevada, 20.-24.3.2016 Ebert, R.: Status of the work of the NATO JCGISR Team of Experts Electro- Optics on Reviewing STANAGS 4347, 4348, 4349, 4350, 4351. NATO SET PBM, Italien, Pisa, 21.-23.10.2016 Van Eijk, A.; Piazzola, J.; Tedeschi. G.; Stein, K.: Aerosol impacts on scene contrast, International IR target and background modeling & simulation workshop (ITBMS). Frankreich, Carcassonne, 28-30.6.2016 El Bekri, N.; Peinsipp-Byma, E.: Assuring Data Quality by Placing the User in the Loop. International Symposium on Big Data and Data Science as part of The 2016 International Conference on Computational Science and Computational Intelligence, USA, Las Vegas, Nevada, 5.-17.12.2016 Essendorfer, B.: Informationsmanagement. Seminar FA1.07 »Daten- und Informati- onsfusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016 Even, M.: A Study on Spatio-Temporal Filtering in the Spirit of SqueeSAR. 11th European Conference on Synthetic Aperture Radar (EUSAR 2016), Hamburg, 6.-9.6.2016 Even, M.: Accelerating Phase Unwrapping Based on Integer Linear Programming by Processing of Subgraphs. 2016 IEEE International Geoscience & Remote Sensing Symposium (IGARSS 2016), China, Peking, 10.-15.7.2016 Van Eijk, A.; Davis, C.; Hammel, S.: Laser Communication and Propagation through the Atmosphere and Oceans V. SPIE San USA, San Diego, Kalifornien, 29-30.8.2016 Eisele, C.: FESTER: a propagation experiment, overview and first results. SPIE Remote Sensing, UK, Edinburgh, 26.-29.9.2016 Eisele, C.; Krieg, J.; Seiffer, D.: Electro-optical muzzle flash detection. SPIE Defense and Security, UK, Edinburgh, 26.-29.9.2016 Eisele, C.: Arbeiten bei der Fraunhofer-Gesellschaft. Berufsvorbereitungs- seminar der jDPG, Magnus-Haus Berlin, 2.-4.12.2016 El Bekri, N.; Syndikus, A.; Peinsipp-Byma, E.: Cluster Rule Based Algorithm for Detecting Incorrect Data Records. UKSim-AMSS 18th International Conference on Modelling & Simulation, Cambridge University, UK, Cambridge, 8.4.2016 El Bekri, N.; Fischer, Y.; Marosz, D.: A knowledge-based approach for task-oriented mission plan- ning. SPIE Conference on Defense and Commercial Sensing, USA, Baltimore, Maryland, 17.-21.4.2016 El Bekri, N.; Peinsipp-Byma, E.: Generic error identification in data sets. 25th International Conference on Software Engineering and Data Engineering, USA, Denver, Colorado, 26.-28.9.2016 Fay, A.; Drumm, O.; Eckhardt, R.; Gutermuth, G.; Krumsiek, D.; Löwen, U.; Makait, T.; Mersch, T.; Schertl, A.; Schindler, T.; Schleipen, M.; Schröck, S.: Durchgängigkeit in Wertschöpfungsketten von Industrie 4.0. Automation 2016, Baden-Baden, 7.-8.6.2016 Felsberg, M.; Kristian, M.; Matas, J.; Arens, M.; Krah, S.; Becker, S.; Hübner, W. et al.: The thermal infrared visual object tracking VOT-TIR2016 challenge results. European Conference on Computer Vision (ECCV), The Visual Object Tracking Challenge Workshop, Niederlande, Amsterdam, 8.-10. und 15.-16.10.2016 Fischer, Y.; Assistenzsysteme zur mulitsensoriellen maritimen Überwa- chung. Angewandte Forschung für Verteidigung und Sicherheit in Deutschland. Eine Veranstaltung der Studiengesellschaft DWT mbH in Zusammenarbeit mit dem BMVg, F&T-Ausschuss des BDSV, Fraunhofer VVS und DLR, Bonn, 23.-25.2.2016 Fischer, Y.; Hempel, D.: OnkoLeit: Ein medizinisches Expertensystem zum Therapie- monitoring von Krebserkrankungen. ITG Workshop Usability, Bonn, 3.6.2016 Fischer, Y.; Anneken, M.: High-Level Datenfusion. Seminar FA 1.07 »Daten- und Informations- fusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 9.11.2016 Flatt, H.: Industrielle Kommunikation im Wandel: Auswirkung von Industrie 4.0 auf IT-Sicherheitskonzepte. 4. VDI-Fachkonferenz Industrial IT Security 2016, Darmstadt, 29.6.2016 1 4 8

151

Flatt, H.: Industrie 4.0 konkret: Intelligente und flexible Forschungsfabrik SmartFactory OWL-Forschungsstand – Praktische Umsetzung – Zukunftsaussichten. Security 2016-Vernetzte Sicherheit / Industrie 4.0, Essen, 28.9.2016 Fullen, M.: Project IMPROVE as a good practice example. Successful R&I between NRW and Poland, Köln, 20.9.2016 Geggus, S.: Ansätze zur Lokalisierung einer Openstreetmap basierten Weltkarte. FOSGISS, Österreich, Salzburg, 3.-6.7.2016 Geggus, S.: Towards a more readable Openstreetmap based world map for westerners. FOSS4G Conference, Bonn, 21.-28.8.2016 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: A framework for voxel-based global scale modeling of urban environments. ISPRS 3rd International GeoAdvances Workshop 2016, Türkei, Istanbul, 16.-17.10.2016 Giessler, P.; Herzog, R.; Abeck, S.: Entwicklung von ressourcenorientierten Services mithilfe des API-Design-First-Prinzips. Karlsruher Entwicklertag, Karlsruhe, 14.6.2016 Gladysz, S.: Absolute and differential G-tilt in turbulence: theory and applications. SPIE Optics in Atmospheric Propagation and Adaptive Systems XIX, UK, Edinburgh, 25.-30.9.2016 Gordon, M.; Hebel, M.; Arens, M.: A descriptor and voting scheme for fast 3D self-localization in man-made environments. IEEE 13th Conference on Computer and Robot Vision CRV 2016, Kanada, Victoria B.C., 1.-3.6.2016 Gross, W.; Böhler J. (Universität Zürich); Twizer, K. (Ben-Gurion-Universität); Kedem, B. (Ben-Gurion-Universität); Lenz, A.; Kneubühler M. (Universität Zürich); Wellig, P. (armasuisse); Oechslin, R. (armasuisse); Schilling, H.; Middelmann, W.: Determination of target detection limits in hyperspectral data using band selection and dimensionality reduction. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 Guan, T.; Frey, C.: Unified predictive fuel efficiency optimization using traffic light sequence information. IEEE Intelligent Vehicles Symposium, Schweden, Göteborg, 19.-22.6.2016 Guan, T.; Frey, C.: Predictive energy efficiency optimization of an electric vehicle using information about traffic light sequences and other vehicles. 19th International Conference on Intelligent Transportation Systems, Brasilien, Rio de Janeiro, 1.-4.11.2016 Haas, C.: Herausforderungen für IT-Sicherheit und Industrie 4.0. Sitzung des Industrieausschusses der IHK Karlsruhe, IOSB Karlsruhe, 7.4.2016 Haas, C.: Design and Architecture of an Industrial IT Security Lab. Tridentcom 2016, China, Hangzhoum, 14.-15.6.2016 Haas, C.: How to deal with IT Security issues in the industrial IoT - The need and the architecture of a flexible Security Lab. Security of Things World, Stream 4, Berlin, 27.6.2016 Haferkorn, D.: An Organizational-Technical Concept to Deal with Open Source Software License Terms. World Multi-Conference on Systemics, Cybernetics and Informatics (WMSCI 2016), USA, Orlando, Florida, 5.-8.7.2016 Gordon, M.: Fast extraction of dominant planes in MLS-data of urban areas. 9th IAPR Workshop on Pattern recognition in Remote Sensing PRRS 2016, Mexiko, Cancun, 4.12.2016 Hammer, H.; Dubois, C.; Boldt, M.; Kuny, S.; Cadario, E.; Thiele, A.: Comparison of Multiple Methods for Detection Changes in Urban Areas in TerraSAR-X Data. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 Grasemann, G.: Erfahrungen mit den automatisierten und harmonisierten Grenz- übertrittskontrollsystem FastPass. VfS Kongress, Potsdam, 5.4.2016 Grasemann, G.; Kaufmann, M.; Peinsipp-Byma, E.: Automated border control with a harmonized modular reference system – Experiences in the EU research project FASTPASS. 11th Future Security; Berlin, 13.-14.9.2016 Hammer, J.-H.: Eye Tracking, Gaze Analysis and Gaze-Based Interaction. Evaluating Use and Impact-Workshop of the Scottish Network on Digital Cultural Resources Evaluation, UK, Glasgow, 31.3.2016 Hammer, J.-H.; Voit, M.; Beyerer, J.: Motion segmentation and appearance change detection based 2D hand tracking. 19th International Conference on Information Fusion, Heidelberg, 5.-8.7.2016 1 4 9

152

LECTURES 2016 VORTRÄGE 2016 Hammer, J.-H.; Qu, C.; Voit, M.; Beyerer, J.: 2D Hand Tracking with Motion Information, Skin Color Clas- sification and Aggregated Channel Features. 20th International Conference on Image Processing, Computer Vision, & Pattern Recognition, USA, Las Vegas, Nevada, 25.-28.7.2016 Hammer, M.; Hebel, M.; Arens, M.: Automated object detection and tracking with a flash LiDAR system. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 Hesse, N.; Stachowiak, G.; Breuer, T.; Arens, M.: Estimating body pose of infants in depth images using random ferns. IEEE International Conference on Computer Vision Workshop (ICCVW 2015), Chile, Santiago, 7.-13.12.2015 Hesse, N.; Stachowiak, G.; Breuer, T.; Arens, M.: Infant body pose estimation for motion analysis. Poster presented at Human Motion Analysis for Healthcare Applications, UK, London, 19.5.2016 Haraké, L.; Schilling, H.; Blohm, C. (OHB System AG); Hillemann, M.; Lenz, A.; Becker, M.; Keskin, G.; Middelmann, W.: Concept for an Airborne Real-Time ISR System with Multi-Sensor 3D Data Acquisition. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 Hild, J.; Kühnle, C.; Beyerer, J.: Gaze-based moving target acquisition in real-time full motion video. ACM Symposium on Eye Tracking Research & Applications, USA, Charleston, South Carolina, 14.-17.3.2016 Heizmann, M.; Puente León, F.; Sommer, K.-D.: Modellbildung in der Mess- und Automatisierungstechnik. VDI / VDE-GMA-Expertenforum »Modellbildung«, Karlsruhe, 2.-3.3.2016 Heizmann, M.; Kühnert, C.; Bernard, T.: Event-Detektion in Trinkwassernetzen mittels PCA und DPCA. VDI / VDE-GMA-Expertenforum »Modellbildung«, Karlsruhe, 2.-3.3.2016 Heizmann, M.: Thermische Deflektometrie zur Inspektion rauer Oberflächen. Optris Infrarot Tour, Ettlingen, 15.-16.3.2016 Heizmann, M.: Roadmap Industrielle Bildverarbeitung – Marktanforderungen und Technologien von morgen. 61. Heidelberger Bildverarbeitungs- forum »Erfolge, Defizite und Zukunftsthemen der Bildverarbeitung«, Festveranstaltung 20 Jahre Heidelberger Bildverarbeitungsforum, Heidelberg, 8.4.2016 Heizmann, M.: Roadmap Industrial Image Processing-Market Requirements and Technologies of Tomorrow. EMVA Business Conference 2016, UK, Edinburgh, 9.-11.6.2016 Heizmann, M.: Thermal Deflektometry. SIS.Europe 2016 - Surface Inspection Summit, Aachen, 28.-29.9.2016 Heizmann, M.: Fusionsmethoden – eine Einführung. Seminar »Daten- und Informationsfusion« der Carl-Cranz-Gesellschaft e. V., Karlsruhe, 7.-10.11.2016 Hild, J.; Petersen, P.; Beyerer, J.: Moving target acquisition by gaze pointing and button press using hand or foot. 2016 ACM Symposium on Eye Tracking Research & Applications, USA, Charleston, South Carolina, 14.-17.3.2016 Hild, J.; Krüger, W.; Peinsipp-Byma, E.; Beyerer, J.: Interacting with target tracking algorithms in a gaze-enhanced motion video analysis system. SPIE Conference on Geospatial Informatics, Fusion, and Motion Video Analytics, USA, Baltimore, Maryland, 19.-21.4.2016 Hilbring, D.: Twitter Sentiment Analysis for German Football Matches. Industry of Things World, Stream 2: Technology and Infrastructure, Berlin, 13.-14.9.2016 Hilsenbeck, B.; Münch, D.; Kieritz, H.; Hübner, W.; Arens, M.: Hierarchical Hough forests for view-independent action recog- nition. IEEE 23rd International Conference on Pattern Recognition ICPR 2016, Mexiko, Cancun, 4.-8.12.2016 Hilsenbeck, B.; Münch, D.; Grosselfinger, A.-K.; Hübner, W.; Arens, M.: Action recognition in the longwave infrared and the visible spectrum using Hough forests. IEEE International Symposium on Multimedia ISM 2016, USA, San Jose, Kalifornien, 11.-13.12.2016 Höfer, S.: Infrarot-Deflektometrie zur Inspektion diffus spiegelnder Oberflächen. Control Vision Talks 2016, Stuttgart, 28.4.2016 Illing, B.; Warweg, O.: Achievable revenues for electric vehicles according to current and future energy market conditions. EEM2016-IEEE European Energy Market, Portugal, Porto, 6.-9.6.2016 Heizmann, M.: - Texturanalyse. - Theorie und Methoden der 3D-Vermessung von Oberflächen. Seminar »Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 7.-8.12.2016 Jacoby, M.; Rauschenbach, T.: Fahrzeugführung von autonomen Unterwasserfahrzeugen zur Pipelineinspektion. 50. Regelungstechnisches Kolloquium, Boppard, 18.2.2016 1 5 0

153

Jacoby, M.; Riedel, T.: Semantic Stream Processing in Dynamic Environments using Dynamic Stream Selection. ML4CPS, Karlsruhe, 29.9.2016 Jacoby, M.; Antonic, A.; Lapacz, R.; Pielorz, J.; Kreiner, K.: Semantic Interoperability as Key to IoT Platform Federation. IoT Conference 2016, 2nd International Workshop on Interoperability & Open Source Solutions for the Internet of Things, Stuttgart, 7.-9.11.2016 Jamboti, K.: Visualization to support identification, exploitation, and fusion of data and information delivered from heterogeneous sources in ISR. SPIE Defense + Commercial Sensing 2016, USA, Baltimore, Maryland, 19.-21.4.2016 Jasperneite, J.; Niggemann, O.: Wie intelligent werden Maschinen? Vortrag anlässlich des 50-jährigen Bestehens der Lemgoer Elektrotechnik, Lemgo, 2.11.2016 Jasperneite, J.: Digital in NRW: Wie kommt Industrie 4.0 in den Mittelstand? Schlossrunde der Gesellschaft für Wirtschaftsförderung im Kreis Höxter mbH, der Industrie- und Handelskammer Ostwestfalen zu Bielefeld, und der Hochschule OWL, Abtei Marienmünster, 23.11.2016 Käßler, M.: Energieforschung am Fraunhofer IOSB-AST. Bürger Energie-Treff Bürgerenergie Jena, Jena, 28.1.2016 Kaufmann, I.: Laser-Doppler-Vibrometrie in der IED- und Minen-Aufklärung. 7. Nationale Counter-IED Konferenz 2016, Bildungszentrum der Bundeswehr, Mannheim, 28.9.2016 Keßler, S.: Performance Assessment of Electro-Optical Systems with TRM4v2 – Status and Future. 11th International ITBM&S Workshop (IR Target and Background, Modeling and Simulation), Frankreich, Carcassonne, 27.6.2016 Keßler, S.; Wittenstein, W.: Reichweitenmodell für Wärmebildgeräte TRM4. Seminar SE 1.02 »Infrarottechnik–Grundlagen, Trends und moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016 Kieritz, H.; Becker, S.; Hübner, W.; Arens, M.: Online multi-person tracking using integral channel features. 13th IEEE International Conference on Advanced Video and Signal Based Surveillance AVSS 2016, USA, Colorado Springs, Colorado, 23.-26.8.2016 Klarner, T.; Arnoldt, A.; Warweg, O.: Intraday Charging Restrictions for Electric Vehicles with Consideration to Grid Capacities. IEEE EnergyCon 2016, Belgien, Leuven, 4.-8.4.2016 Kottler, B.; Bulatov, D.; Schilling, H.: Improving Semantic Orthophotos by a Fast Method Based on Harmonic Inpainting. 23rd International Conference on Pattern Recognition (ICPR), Mexiko, Cancun, 4.-8.12.2016 Krempel, E.; Birnstill, P.; Beyerer, J.: Working and living in interactive environments requirements for security and privacy. 11th Future Security, Berlin, 13.-14.9.2016 Kristan, M.; Leonardis, A.; Matas, J.; Becker, S.; Krah, S.; Hübner, W.; Arens, M. et al.: The visual object tracking VOT2016 challenge results. European Conference on Computer Vision (ECCV), The Visual Object Tracking Challenge Workshop, Niederlande, Amsterdam, 8.-10. und 15.-16.10.2016 Kuny, S.: Sensordatenfusion für interaktive Luft- und Satelliten- bildauswertung. Seminar SE 2.18 Multisensordatenfusion: Grundlagen und Anwendungen der Carl-Cranz-Gesellschaft e.V., Wachtberg-Werthhoven, 19.-21.4.2016 Kuny, S.; Hammer, H.; Schulz, K.: Towards a Reliable Detection of Debris in High Resolution SAR Images of Urban Areas. 11th European Conference on Synthetic Aperture Radar (EUSAR 2016), Hamburg, 6.-9.6.2016 Kuny, S.; Hammer, H.; Schulz, K.: Assessing the Suitability of simulated SAR Signatures of Debris for the Usage in Damage Detection. International Society for Photogrammetry and Remote Sensing (ISPRS 2016), Tschechien, Prag, 12.-19.7.2016 Kuwertz, A.: Using heterogeneous multilevel swarms of UAVs and high-level data fusion to support situation management in surveillance scenarios. 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Baden-Baden, 19.-21.9.2016 Kuwertz, A.: Vorgehen und Werkzeuge für die angewandte Informations- fusion. Seminar, FA1.07 »Daten- und Informationsfusion« der Carl- Cranz-Gesellschaft e.V., Fraunhofer IOSB, Karlsruhe, 7.-10.11.2016 Längle, T.: Optical Computing zur materialselektiven Sortierung feinkörnigen Bauschutts. Fachtagung Recycling R’16, Weimar, 19.-20.9.2016 Längle, T.: Introduction to Data Fusion in Sensor-Based Sorting. 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016); Special Session: Data Fusion in Sensor-based Sorting, Baden-Baden, 21.9.2016 1 5 1

154

LECTURES 2016 VORTRÄGE 2016 Le, T.-T.; Ziebarth, M.; Greiner, T.; Heizmann, H.; Systematic design of object shape matched wavelet filter banks for defect detection. International Conference on Telecommunications and Signal Processing 2016, Österreich, Wien, 27.6.2016 Maier, G.: High-throughput sensor-based sorting via approximate computing. Forum Bildverarbeitung 2016, Karlsruhe, 1.12.2016 Lenz, A.; Keskin, G.; Schilling, H.; Groß, W.; Middelmann, W.: Ship classification in terrestrial hyperspectral data. SPIE 2016, UK, Edinburgh, 26.-29.9.2016 / Vortrag: A. Lenz Li, Q.; Müller, F.; Wenzel, A.; Rauschenbach, T.: Simulation-based comparison of 2D Scan Matching algorithms for different rangefinders. 21st International Conference on Methods and Models in Automation and Robotics (MMAR), Polen, Miedzyzdroje, 29.8.-1.9.2016 Luo, D.: Optical unmixing using programmable spectral source based on DMD. SPIE 9855, Next-Generation Spectroscopic Technologies IX, USA, Baltimore, Maryland, 12.5.2016 Luo, D.: Compressive shape from focus based on a linear measurement model. Forum Bildverarbeitung 2016, Karlsruhe, 2.12.2016 Lutzmann, P.: - Gated-Viewing Systeme. - Laser Vibrometrie. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 13.4.2016 Lutzmann, P.; Göhler, B.; Scherer-Klöckling, C.; Scherer-Negenborn, N.; Brunner, S.; van Putten, F.; Hill, C.A.: Laser Doppler vibrometry on rotating wind turbine blades. 18th Coherent Laser radar Conference CLRC 2016, USA, Boulder, Colorado, 27.6.-1.7.2016 Lutzmann, P.: Laser doppler vibrometry on rotating wind turbine blades. 18th Coherent Laser Radar Conference, CLRC 2016, USA, Boulder, Colorado, 30.6.2016 Lutzmann, P.: Militärisches und ziviles Potenzial des Laserradars. Seminar SE 1.02 »Infrarottechnik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016 Maier, G.: Fast Multitarget Tracking Via Strategy Switching for Sensor- Based Sorting. 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2016); Special Session: Data Fusion in Sensor-based Sorting, Baden-Baden, 21.9.2016 Martin, M.; Diederichs, F.; Li, K.; Voit, M.; Melcher, V.; Widlroither, H.; Stiefelhagen, R.: Klassifikation von Fahrerzuständen und Nebentätigkeiten über Körperposen bei automatisierter Fahrt. VDI / VW Gemeinschafts- tagung Fahrerassistenzsysteme und automatisiertes Fahren, Wolfsburg, 8.-9.11.2016 Meidow, J.; Hammer, H.; Pohl, M.; Bulatov, D.: Enhancement of Generic Building Models by Recognition and Enforcement of Geometric Constraints. ISPRS Congress 2016, Tschechien, Prag, 12.-19.7.2016 Meier, D.: Herausforderungen bei der Sicherheitsanalyse von industriellen Systemen. CAST Workshop »Mobile und Embedded Security«, Darmstadt, 2.6.2016 Meyer, J.: Simulation of an Inverse Schlieren Image Acquisition System for Inspecting Transparent Objects. IS&T International Symposium on Electronic Imaging 2016, USA, San Francisco, Kalifornien, 17.2.2016 Meyer, J.: About the Acquisition and Processing of Ray Deflection Histograms for Transparent Object Inspection. 18th Irish Machine Vision & Image Processing Conference Proceedings 2016; Irland, Galway, 25.8.2016 Meyer, J.: Acquiring and Processing Light Deflection Maps for Transparent Object Inspection. 2nd International Conference on Frontiers of Signal Processing (ICFSP 2016), Polen, Warschau, 16.10.2016 Meyer, J.: Light transport matrix acquisition and processing for transparent object inspection. Forum Bildverarbeitung 2016, Karlsruhe, 1.12.2016 Michaelsen, E.; Münch, D.; Arens, M.: Searching remotely sensed images for meaningful nested gestalten. XXIII ISPRS Congress 2016, Tschechien, Prag, 12.-19.7.2016 Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Dachsbacher, C.; Wörn, H.: Performance Characterization in Automated Optical Inspection using CAD Models and Graphical Simulations. AHMT 2016, Deutschland, Hannover, 16.9.2016 Münch, D.; Becker, S.; Kieritz, H.; Hübner, W.; Arens, M.: Video-based log generation for security systems in indoor surveillance scenarios. 11th Future Security, Berlin, 13.-14.9.2016 1 5 2

155

Münch, D.; Hilsenbeck, B.; Kieritz, H.; Becker, S.; Grosselfinger, A.-K.; Hübner, W.; Arens, M.: Detection of infrastructure manipulation with knowledge-based video surveillance. SPIE Security + Defence 2016, UK, Edinburgh, 26.-29.9.2016 Negara, C.: Retroreflective Laser Scanner System for Inline Ellipsometric Measurements at Curved Surfaces. 7th International Conference on Spectroscopic Ellipsometry (ICSE-7), Berlin, 6.6.2016 Nguyen, L.; Karimanzira, D.; Rauschenbach, T.; Ribbe, L.: A procedure for approximating a complex hydrodynamic model by the adaptive time delay method. World Environmental and Water Resources Congress, USA, West Palm Beach, Florida, 22.-26.5.2016 Pak, A.: The concept and implementation of smooth generic camera calibration. SPIE Optical Engineering + Applications, USA, San Diego, Kalifornien, 28.8.2016 Peinsipp-Byma, E.: Befehlsstelle der Zukunft. Fachveranstaltung »Neue Technologien für die Terrorabwehr der FhG« am Fraunhofer IOSB, Karlsruhe, 8.3.2016 Peinsipp-Byma, E.: Rechnergestützte Satelliten- und Luftbildauswertung. Seminar FA 1.05 »Aufklärung mit moderner Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 31.5.2016 Peinsipp-Byma, E.: Erkennungsunterstützung. Seminar FA 1.15 »Luft- und raum- gestützte Bildaufklärung« der Carl-Cranz-Gesellschaft e.V., Fraunhofer IOSB Karlsruhe, 13.-16.6.2016 Pfrommer, J.: Semantic Interoperability at Big-Data Scale for the Industrial Internet of Things with the open62541 OPC UA Implementation. IOT Conference 2016, 2nd International Workshop on Interoperability & Open Source Solutions for the Internet of Things, Stuttgart, 7.-9.11.2016 Philipp, P.; Schreiter, L.; Giehl, J.; Fischer, Y.; Raczkowsky, J.; Schwarz, M.; Wörn, H.; Beyerer, J.: Situation Detection for an Interactive Assistance in Surgical Interventions Based on Dynamic Bayesian Networks. 6th Joint Workshop on New Technologies for Computer / Robot Assisted Surgery, Italien, Pisa, 12.-14.9.2016 Richter, M.: Feature Selection with a Budget. 2nd World Congress on Electrical Engineering and Computer Systems and Science (EECSS’16), Ungarn, Budapest, 16.8.2016 Richter, M.: Combining synthetic image acquisition and machine learning: accelerated design and deployment of sorting systems. Forum Bildverarbeitung 2016, Karlsruhe, 1.12.2016 Richter, M.: Knowing when you don't: Bag of visual words with reject option for automatic visual inspection of bulk materials. 23rd International Conference on Pattern Recognition (ICPR 2016), Mexiko, Cancun, 6.12.2016 Ritter, S.: Potentiale der Querverbundoptimierung im Kontext neuer Technologien. Thüga-Forum: Thermische Energiespeicher, Würzburg, 8.6.2016 Roller, W.: Auswertung von SAR-Bilddaten. Seminar SE 3.27 »Miniaturisierte Sensorik für den UAV-Einsatz« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 2.6.2016 Roller, W.: Synthetisches Apertur Radar-Grundlagen. Fachtechnische Grund- lagen - Informationstechnik und Elektronik, BiZBw, Mannheim, 3.6.2016 Roller, W.; Streicher, A.: Adaptive Wissensvermittlung für Serious Games und Simulatio- nen. Ausbildungskongress der Bundeswehr, Hamburg, 13.-15.9.2016 Rublack, L.; Warweg, O.; Bretschneider, P.; Freund, S.; Bieber, M.: Sensitivity Analysis of Adiabatic Compressed Air Energy Storage. IEEE PES Innovative Smart Grid Technologies, Slowenien, Ljubljane, 10.-12.10.2016 Sander, J.: A computer-aided assistance system for ressource-optimal sensor scheduling in Intelligence, Surveillance, and Reconnaissance. 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Baden-Baden, 19.-21.9.2016 Sander, J.: Ansätze zur lokalen Bayes'schen Informationsfusion. Seminar FA1.07 »Daten- und Informationsfusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016 Richter, M.: Bag of visual words-A computer vision method applied to bulk material sorting. 7th Sensor-Based Sorting & Control 2016, Aachen, 24.2.2016 Sander, J.: Assistenzsysteme, Informationsfusion und Signaturdatenbanken. Seminar, FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« der Carl-Cranz Gesellschaft e.V., Fraunhofer IOSB, Karlsruhe, 22.-23.11.2016 1 5 3

156

LECTURES 2016 VORTRÄGE 2016 Santamaria, E.; Moßgraber, J.; Deuerlein, J.; Kühnert, C.; Bernard, T.: An integrated system for enhanced response management in CBRN related contamination events of drinking water. 14th inter- national CCWI Conference, Niederlande, Amsterdam, 7.-9.11.2016 Schleipen, M.: Harmonisierung von Automation ML und OPC UA – Zwei Standards für Industrie 4.0, eine Lösung für den Anwender. VDI Konferenz Industrie 4.0, Düsseldorf, 27.-28.1.2016 Schneider, M.; Walther, C.; Wenzel, A.: Classification of Production Quality in Injection Moulding with an Embedded Diagnostic System Using a Fuzzy Inference System. 26th Workshop on Computational Intelligence, Dortmund, 24.-25.11.2016 Schulz, K.: GIS und Sensordatenfusion. Seminar FA 1.07 »Daten- und Informati- onsfusion« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 7.-10.11.2016 Schleipen, M.: PLUGandWORK auf Basis der offenen internationalen Standards Automation ML und OPC UA. Forum Industrie 4.0, Hannover, 27.4.2016 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 16.6.2016 Schleipen, M.; Röhrig, B.; Tröger, K.; Löfters, C.: Industrie 4.0 – wie wird Visual Computing die Fertigungs- landschaft revolutionieren? 8. MES-Tagung-MES in der Praxis, Hannover, 28.4.2016 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE1.02 »Infrarottechnik-Grundlagen, Trends und moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 20.10.2016 Schleipen, M.; Gilani, S.; Bischoff, T.; Pfrommer, J.: OPC UA & Industrie 4.0-enabling technology with high diversity and variability. CIRP-CMS 2016, Stuttgart, 26.5.2016 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE2.14 »Radar-, VIS- und IR Signaturen: Technik und Anwendung« der Carl-Cranz-Gesellschaft e.V., 29.11.2016 Schleipen, M.: PLUGandWORK basierend auf offenen Standards. Fachforum Industrie 4.0, Technologie Centrum Westbayern, Nördlingen, 31.5.2016 Schleipen, M.; Pfrommer, J.: OPC UA als Basistechnologie zur Orchestrierung von Produkti- onssystemen. Automation 2016, Baden-Baden, 8.6.2016 Schleipen, M.: Combining Automation ML and OPC UA. OPC Day, Finnland, Hyvinkää, 18.10.2016 Schleipen, M.: AutomationML and OPC UA – enabling technologies for PLUGandWORK in a smart production. 4th AML User Conference, Esslingen, 18.-19.10.2016 Schmieder, M.; Moßgraber, J.: Komplexe Auswertung von Fachinformationen am Beispiel der Fachanwendung Grundwasser Baden-Württemberg. 23. Workshop Arbeitsreis Umweltinformationssysteme-UIS 2016 »Umweltbeobachtung nah und fern«, Leipzig, 2.6.2016 Schneider, D.: Industry 4.0: From data acquisition to the cloud in the context of IT Security. Cyber Security for Industrial Control Systems, 3. CYBICS, Bochum, 24.2.2016 Schweitzer, C.: Assessment of Space-Based Early Warning Systems for TBM Detection. NATO Space Symposium, UK, Universität Loughborough, 17.-19.5.2016 Seyboldt, R.; Frese, C.; Zube, A.: Sampling-based Path Planning to Cartesian Goal Positions for a Mobile Manipulator Exploiting Kinematic Redundancy. 47th International Symposium on Robotics (ISR), München, 21.6.2016 Sidorenko, J.; Scherer-Negenborn, N.; Arens, M.; Michaelsen, E.: Multilateration of the local position measurement. IEEE Interna- tional Conference on Indoor Positioning and Indoor Navigation IPIN, Spanien, Madrid, 4.-7.10.2016 Stephan, T.; Dürrwang, J.; Burke, J.; Werling, S.; Beyerer, J: Extended Photometric Stereo Model. Forum Bildverarbeitung, Deutschland, Karlsruhe, 2.12.2016 Streicher, A.: Das Technologieakzeptanzmodell für kartenbasierte Lernspiele in der Bildauswertung. DeLFI 2016-Die 14. E-Learning Fachtagung Informatik der Gesellschaft für Informatik e.V., Postdam, 11.-14.9.2016 Streicher, A.: Game-Based Training for Complex Multi-institutional Exercises of Joint Forces. Adaptive and Adaptable Learning: 11th European Conference on Technology Enhanced Learning, EC-TEL 2016, Frankreich, Lyon, 13.-16.9.2016 1 5 4

157

Tchouchenkov, I.; Schönbein, R.: Eigenschaften, Detektions- und Abwehrmöglichkeiten von kleinen UAS. 1. Counter-UAS Kolloquium, Karlsruhe, 16.3.2016 Usländer, T.: Visionen-Industrie 4.0-wo stehen wir in 5 Jahren? Industrie 4.0 »Smart Factory Smart People«, Italien, Mailand, 19.10.2016 Tchouchenkov, I.: - Eigenschaften und Technik von Kleindrohnen. - Einsatzmöglichkeiten, Gefahren, Rechtslage. - Bekämpfungsmöglichkeiten. - Stand der Technik – Kontroll- und Abwehrsysteme. Seminar FA 1.26 »Einsatz und Bekämpfung von Kleindrohnen« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 22.-23.11.2016 Thiele, A.; Dubois, C. (KIT); Boldt, M.; Hinz, S. (KIT): Using TanDEM Data for Forest Height Estimation and Change Detection. SPIE Remote Sensing 2016, UK, Edinburgh, 26.-29.9.2016 Thomalla, C.: Predicticve Analytics im Kontext IT Security und Industrie 4.0. Sitzung des Industrieausschusses der IHK Karlsruhe, IOSB Karlsruhe, 3.5.2016 Thomé, S.; Michaelsen, E.; Scherer-Negenborn, N.; Jäger, K.; Doktorski, L.: Fusion of trackers on thermal image sequences. IEEE 18th International Conference on Information Fusion FUSION, USA, Washington D.C., 6.-9.7.2015 Usländer, T.: Agile Service Engineering for the Industrial Internet of Things. Bitkom Innovation Forum, HMI, Hannover, 26.4.2016 Usländer, T.: Agile Service-oriented Analysis and Design of Industrial Internet Applications. CIRP-CMS 2016, Stuttgart, 25.-27.5.2016 Usländer, T.: Agiles Service-Engineering für Industrie 4.0. Automation 2016, Baden-Baden, 7.-8.6.2016 Usländer, T.: Redesigning industries and enterprises in world of connected objects. Power Meeting, IoT Summit, Italien, Mailand, 16.6.2016 Usländer, T.: Internet der Dinge-Technologie, Geschäftsmodelle und Stan- dardisierung (Industrie 4.0). Klausurtagung der IT-Ressortleiter des Innenministeriums, Rastatt, 23.6.2016 Usländer, T.: Risks of Industrie 4.0-An Information Technology Perspective. IDRV Schweiz, Davos, 28.8.-1.9.2016 Usländer, T.: Engineering IIoT systems in an agile manner. Industry of Things World, Stream 2: Technology and Infrastructure, Berlin, 19.-20.9.2016 Usländer, T.: Industrie 4.0 Standardisierung-Übersicht und aktueller Stand. Technikforum Industrie 4.0 - Chance und Herausforderungen für den Mittelstand, Nördlingen, 15.11.2016 Usländer, T.: IoT Standardization for Factory Automation-Insights into the Industrie 4.0 Approach. IoT World Europe, Irland, Dublin, 22.11.2016 Wagner, B.; Eck, R.; Unmuessig, G.; Peinsipp-Byma, E.: Interactive analysis of geodata based intelligence. SPIE Conference on Sensors, and Command, Control, Communications, and Intelligence, USA, Baltimore, Maryland, 18.-19.7.2016 Wagner, P.; Birnstill, P.; Krempel, E.; Bretthauer, S.; Beyerer, J.: Privacy-Dashcam-Datenschutzfreundliche Dashcams durch Erzwingen externer Anonymisierung. Informatik 2016, Öster- reich, Klagenfurt, 26.-30.9.2016 Warweg, O.: From Energy Efficient Buildings to Energy Efficient Districts, Challenges for the Energy Management. Smart Energy Cities Conference at BIXPO, Südkorea, Gwangju, 3.11.2016 Watson, K.: IIC Testbed-Smart Factory Web. Testbed Working Group Meeting des IIC Consortium Quarterly Meeting, St.-Leon-Rot, 20.9.2016 Watson, K.: Creating a Smart Factory Web Based upon AutomationML. 4th AML User Conference, Esslingen, 18.-19.10.2016 Wuttke, S.; Middelmann, W.; Stilla, U. (TU München): Active Learning with SVM for Land Cover Classification-What Can Go Wrong? i-KNOW 2016-Workshop on Active Learning, Österreich, Graz, 17.-19.10.2016 Zaschke, C.: Interoperability of heterogeneous distributed systems. SPIE Defense + Commercial Sensing 2016, USA, Baltimore, Maryland, 17.-21.4.2016 Zimmermann, T.; Klaiber, S.; Bretschneider, P.: A Market System Operator as a new role to balance the distribution grid and to coordinate market and grid operations. IEEE EnergyCon 2016, Belgien, Leuven, 4.-8.4.2016 Zube, A.; Hofmann, J.; Frese, C.: Model Predictive Contact Control for Human-Robot Interaction. 47th International Symposium on Robotics (ISR), München, 22.6.2016 1 5 5

158

LECTURES 2017 VORTRÄGE 2017 Abel, P.; Kieritz, H.; Becker, S.; Arens, M.: Robust Visual Object Tracking with Interleaved Segmentation. SPIE Security + Defence 2017, Polen, Warschau, 11.-14.9.2017 Beyerer, J.: Beitrag zur Formulierung einer »Systemtheorie Sicherheit« Soziotechnischer Systeme. KASTEL, Karlsruhe, 28.2.2017 Adomeit, U.; Krieg, J.: Investigating Nightglow Illumination for Night Vision Applica- tions. 43. Freiburger Infrarotkolloquium, Freiburg, 14.3.2017 Beyerer, J.: Ausgewählte Beispiele zur KI-Forschung am IOSB. Digital Hub, Karlsruhe, 6.3.2017 Albrecht, A.: Application of an off-the-shelf Fiber Optic Gyroscope based Inertial Measurement Unit for Attitude and Heading Estimation. IEEE SENSORS 2017, UK, Glasgow, 29.10.-1.11.2017 Beyerer, J.: IT-Sicherheitsforschung bei Fraunhofer –Theorie, Technologien, Labore und Fortbildung. Lernlaboreröffnung Lemgo, Lemgo, 16.3.2017 Anneken, M.; Fischer, Y.; Beyerer, J.: A multi-agent approach to model and analyze the behavior of vessels in the maritime domain. International Conference on Agents and Artificial Intelligence 2017, Portugal, Porto, 24.-26.2.2017 Beyerer, J.: Fit für die Zukunft? Perspektiven der Verteidigungsforschung in Deutschland. Kooperationsveranstaltung der Fraunhofer-Gesellschaft und der Deutschen Gesellschaft für Wehrtechnik mbH, Gesellschaft für Sicherheitspolitik e.V., Berlin, 23.3.2017 Anstett, G.: Neue Sensorkonzepte: THz-Technologie und -Sensoren. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheits- relevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 10.5.2017 Beyerer, J.: Videoüberwachung für die Sicherheit - Funktionen, Systeme und Herausforderungen. Behördentag IOSB, Fraunhofer IOSB, Karlsruhe, 8.5.2017 Bapp, F.; Becker, J.; Beyerer, J.; Doll, J.; Filsinger, M.; Frese, Ch.; Hubschneider, Ch.; Lauber, A.; Müller-Quade (KIT), J.; Pauli, M.; Roschani, M.; Salscheider, O.; Rosenhahn, B.; Ruf, M.; Stiller, Ch.; Willersinn, D.; Ziehn, J.R.: A Non-Invasive Cyberrisk in Cooperative Driving. 8. Tagung Fahrerassistenz: Einführung hochautomatisiertes Fahren, München, 22.-23.11.2017 Becker, M.; Runkel, I. (Fa. GEOSYSTEMS); Espinosa, N.; Middelmann, W.: 3D Building Reconstruction in a remote sensing application workflow. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 Beyerer, J.: IT-Sicherheitsforschung bei Fraunhofer – Theorie, Technologien, Labore und Fortbildung. Eröffnung des gemeinsamen Lernlabors Cybersicherheit der Hochschule Zittau / Görlitz und des Fraunhofer IOSB – Institutsteil Angewandte Systemtechnik, Hochschule Zittau / Görlitz, Görlitz, 11.1.2017 Beyerer, J.: Kritische Infrastrukturen – Risiken, Schutz und Resilienz. Inno- vation mit Tradition – Metzler meets Fraunhofer, Business-Lunch zum Thema »Schutz und Sicherheit – widerstandsfähige Infrastrukturen«, Bankhaus Metzler, Frankfurt, 2.2.2017 Beyerer, J.: Sicherheit und Resilienz. Fraunhofer Morgen-Radar: »Sicherheit und Resilienz«, Berlin, 15.2.2017 Beyerer, J.: Fraunhofer-Verbund Verteidigungs- und Sicherheitsforschung VVS – Aktivitäten der diversen Institute. F&T-Symposium Counter UAS – Neue Wege in der Drohnenbekämpfung, Bildungszentrum der Bundeswehr, Mannheim, 27.-28.6.2017 Beyerer, J.: Intelligente Autonome Systeme - Eine Tour d‘horizon aus Sicht der Forschung. Unmanned Vehicles VI, Studiengesellschaft der Deutschen Gesellschaft für Wehrtechnik mbH, Bonn Bad Godesberg, 4.7.2017 Beyerer, J.: Quantifizierung von Risiko. Sommerseminar, Griesget-Hof, 1.8.2017 Beyerer, J.: Maschinelles Lernen und Künstliche Intelligenz verändern die Industrielle Automatisierung. Kolloquium: Netze und Brücken, Fraunhofer IOSB, 13.9.2017 Beyerer, J.: Blick in die Fraunhofer-Labore. Fraunhofer-Tag der Künstlichen Intelligenz, »MIT KOGNITIVEN SYSTEMEN, LERNENDEN MASCHINEN UND DIGITALEN ASSISTENTEN DIE ZUKUNFT GESTALTEN«, Fraunhofer-Forum Berlin, 29.11.2017 Blume, M.; Flatt, H.: Intelligente Inbetriebnahme von Maschinen und verketteten Anlagen-SecurePLUGandWORK. Wissenschafts-und Industrieforum Intelligente Technische Systeme, Paderborn, 11.5.2017 1 5 6

159

Boldt, M.; Thiele, A.; Schulz, K.; Hinz, S. (KIT): Change Classification in SAR Time Series: A Functional Approach. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 Borgmann, B.; Hebel, M.; Arens, M.; Stilla, U.: Konzept zur Gefährdungserkennung im städtischen Verkehrsraum durch Personendetektion in MLS-Punktwolken. 37. Wissenschaftlich-Technische Jahrestagung der DGPF 2017, Würzburg, 8.-10.3.2017 Borgmann, B.; Hebel, M.; Arens, M.; Stilla, U.: Detection of persons in MLS point clouds using Implicit Shape Models. The ISPRS Geospatial Week 2017, China, Wuhan, 18.-22.9.2017 Brink, G.; Mulay, G.: Fast Leaps and Deep Dives towards Autonomous, Fast, and High-Resolution Deep-Sea Ocean Exploration. 16th Conference on Computer and IT Applications in the Maritime Industries (COMPIT’17), UK, Cardiff, 15.-17.5.2017 Brink, G.: Active Contributions from the AUV during the Recovery Process: our novel c-LARS Launch and Recovery System. 2. LARSFORUM on launch and recovery, UK, London, 7.-8.6.2017 Bulatov, D.; Wenzel, S. (Institut für Geodäsie und Geoinformation, Universität Bonn); Häufel, G.; Meidow, J.: Chain-wise Generalization of Road Networks using Model Selection. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover-Workshop), Hannover, 6.-9.6.2017 Burke, J.; Zhong, L.: Unterdrückung von Kontrast-Artefakten bei der Phasenmessung. Jahrestagung DGaO, Deutschland, Dresden, 7.6.2017 Burke, J.; Zhong, L.: Suppression of contrast-related artefacts in phase-measuring structured light techniques. SPIE Optical Measurement Systems for Industrial Inspection X, Deutschland, München, 27.6.2017 Doktorski, L.: An Application of Limiting Interpolation to the Fourier Series Theory. 28th International Workshop on Operator Theory and its Applications IWOTA 2017, Chemnitz, 14.-18.8.2017 Ebert, R.: New Research Activities at Fraunhofer IOSB. ONERA / DOTA, Frankreich, Palaiseau, 7.3.2017 Eberle, B.: - Einführung in das Thema Laser-Radar. - Operationelle Grundlagen für Lasersensoren. - Laserradar: Verfahren und Systeme. - Fernerkennung von Bedrohungen und Gefahren. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicher- heitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 9.-11.5.2017 Ebert, R.: Technical Watch on Nigh Vision Sensor Image Fusion Vision Sensor Image Fusion. NATO SET PBM, Finnland, Helsinki, 21.-23.5.2017 Eberle, B.: - Grundlagen zum Seminarthema. - Lasergestützte Aufklärung mittels Laser-Radaren Seminar FA 1.06 »Aufklärung mit moderner Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 30.5.-1.6.2017 Eberle, B.: Laser-Radarsysteme für Zielaufklärung und Navigation. Seminar SE 2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 22.6.2017 Eck, R.; Wagner, B.: Interaktive Visualisierung von OGC-standardisierten Geodaten. Workshop des Bundesamtes für Kartographie und Geodäsie »Gewußt wo!«, Frankfurt, 22.2.2017 Eck, R.: Interaktive Visualisierung geodatenbasierter Lagedaten. Innovationsworkshop »Einsatzzentrale & Einsatz- / Lageführung der Zukunft« der Kantonspolizei, Schweiz, Zürich, 31.3.2017 Eisele, C.; Sucher, E.; Wendelstein, N.; Stein, K.: Electro-optical propagation measurements during the MINOTAUROS experiment in the Cretan Sea. SPIE Remote Sensing, Polen, Warschau, 10.–15.9.2017 Emter, T.: Algorithmen-Toolbox für autonome mobile Roboter. DWT- Tagung »Unmanned Vehicles VI«, Bonn Bad Godesberg, 4.-5.7.2017 Frese, C.: Kooperatives Fahren – Benefits und Methoden. Industriearbeitskreis »Vernetzte Mobilität« der »Profilregion Mobilitätssysteme Karlsruhe«, Thema »Resilientes kooperatives Fahren im Mischverkehr«, Karlsruhe, 19.5.2017 Eberle, B.: Nonlinear Optical Effects in Colloidal Carbon Nano-Horns. ISL Scientific Symposium 2017 on Protection Technologies, ISL Saint-Louis, Frankreich, Saint-Louis, 14.3.2017 Fullen, M.: Project IMPROVE as a good practice example. HMI 2017, North Rhine-Westphalia-Poland: two strong partners in science and business, Hannover, 26.4.2017 1 5 7

160

LECTURES 2017 VORTRÄGE 2017 Fullen, M.: Defining and Validating Similarity Measures for Industrial Alarm Flood Analysis. IEEE 15th International Conference on Industrial Informatics INDIN‘2017, Emden, 26.7.2017 Gruna, R.: Optische Sortierung von Bauschutt-Herausforderungen und Lösungsansätze. Workshop UMSICHT: Zur Sache!, Oberhausen, 26.1.2017 Fullen, M.: Semi-supervised Case-based Approach to Alarm Flood Analysis. 3. Fachkonferenz Maschinelles Lernen in der Produktion (ML4CPS 2017), Lemgo, 26.10.2017 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: Filtern bewegter Objekte aus mobilen LiDAR-Daten auf Grund- lage volumetrischer Modelle. 37. Wissenschaftlich-Technische Jahrestagung der DGPF 2017, Würzburg, 8.-10.3.2017 Gehrung, J.; Hebel, M.; Arens, M.; Stilla, U.: An approach to extract moving objects from MLS data using a volumetric background representation. ISPRS Hannover Workshop 2017: High-Resolution Earth Imaging for Geospatial Information (HRIGI), Hannover, 6.-9.6.2017 Geisler, J.: Verteidigungs- und Sicherheitsforschung in der Fraunhofer-Gesellschaft: Aktuelle Themen und Trends. Anlässlich Mitgliederversammlung der Carl-Cranz-Gesellschaft e. V., Oberpfaffenhofen, 12.5.2017 Giese, K.: Differential Evolution in Production Process-Optimization of Cyber Physical Systems. 3. Fachkonferenz Maschinelles Lernen in der Produktion (ML4CPS 2017), Lemgo, 25.10.2017 Gladysz, S.: Nearly complete characterization of optical turbulence with an LED array. Turbulence Profiling Workshop, Frankreich, Marseille, 21.-22.3.2017 Gladysz, S.: Nearly Complete Characterization of Optical Turbulence with an LED Array. OSA Imaging and Applied Optics Congress, USA, San Francisco, Kalifornien, 25.-29.6.2017 Gladysz, S.; Barros, R.: Characterization of underwater optical turbulence on the example of the Rayleigh-Benard water tank. SPIE Remote Sensing, Polen, Warschau, 10.-15.9.2017 Großmann, P.: Thermisches Objektmodell (F-TOM) zur Vorhersage der Temperatur von Objekten und Hintergründen in unterschiedli- chen spektralen Bändern. 9. DWT-Tagung Optik und Optronik in der Wehrtechnik, Meppen, 25.-28.9.2017 Gruna, R.: Comparability of spectroscopic measurements from different institutes and sensors; Evaluation based on different food samples. OCM-SpectroNet Collaboration Conference 2017, Karlsruhe, 21.3.2017 Gruna, R.: Farbmessung. Fraunhofer VISION-Seminar mit Praktikum: Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung, Karlsruhe, 5.12.2017 Guan, T.; Frey, C.: Improvement of predictive energy efficiency optimization using long distance horizon estimation. IEEE Intelligent Vehicles Symposium 2017, USA, Redondo Beach, Kalifornien, 11.-14.6.2017 Haas, C.: Wissen und Prüfung von Menschen und Produkten-Security Testlab und Academy. VDMA Infotag Industrial Security, Frankfurt a. M., 22.2.2017 Häufel, G.; Bulatov, H.: Sensor Data Fusion for Textured Reconstruction and Virtual Representation of Alpine Scenes. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 Hammer, M.; Hebel, M.; Arens, M.: Person detection and tracking with a 360° LiDAR system. SPIE Security + Defence 2017, Polen, Warschau, 11.-14.9.2017 Heinze, N.; Brandstetter, A. (Hensoldt Sensors): Manned Unmanned Teaming LOI 3 Sensorfusion – Integration von UAS-Videofunktionen in bemannte fliegende Systeme. SGW-Forum Unmanned Vehicles VI, Bonn Bad Godesberg, 4.-5.7.2017 Heizmann, M.: Industrielle Bildverarbeitung – die wachen Augen der Qualitätssicherung. 4. Innovationsforum Quality Engineering, Konradin-Verlag, Echterdingen, 11.10.2017 Heizmann, M.: Technologien und Anwendungen von morgen – Ausgewählte Trends in der Bildverarbeitung. Fraunhofer Vision Technologietag 2017-Jubiläumskongress 20 Jahre Fraunhofer Vision, Fürth, 25.-26.10.2017 1 5 8

161

Heizmann, M.: - Theorie und Methoden der 3D-Vermessung von Oberflächen. - Texturanalyse. Seminar »Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 5.-6.12.2017 Jacoby, M.: Approaches to Semantic Interoperability & Semantic Mapping. Workshop on IoT Semantic / Hypermedia Interoperability, Tschechien, Prag, 15.-16.7.2017 Heizmann, M.: Texturanalyse. Seminar »Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 5.-6.12.2017 Hesse, N.; Schroeder, S.; Müller-Felber, W.; Bodensteiner, C.; Arens, M.; Hofmann, U.: Markerless motion analysis for early detection of infantile movement disorders. EMBEC & NBC 2017, Joint Conference of the European Medical and Biological Engineering Conference and the Nordic-Baltic Conference on Biomedical Engineering and Medical Physics, Finnland, Tampere, 11.-15.6.2017 Hesse, N.; Bodensteiner C.; Arens, M.; Hofmann, U.: Body Pose Estimation in Depth Images for Infant Motion Analysis. 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Südkorea, Jeju Island, 11.-15.7.2017 Heymann, S.: OPC UA Workshop. Smart Factory Web Projekt (Keti), Südkorea, Pangyo, 17.-21.7.2017 Hild, J.; Krüger, W.; Brüstle, S.; Trantelle, P.; Unmüßig, G.; Voit, M.; Heinze, N.; Peinsipp-Byma, E.; Beyerer, J.: Pilot study on real-time motion detection in UAS video data by human observer and image exploitation algotithm. SPIE Conference on Defence and Commercial Sensing, USA, Anaheim, Kalifornien, 9.-13.4.2017 Hillemann, M.; Jutzi B. (KIT): UCalMiCeL-UNIFIED INTRINSIC AND EXTRINSIC CALIBRATION OF A MULTI-CAMERA-SYSTEM AND A LASERSCANNER. International Conference on Unmanned Aerial Vehicles in Geomatics (UAV-g), Bonn, 4.-7.9.2017 Höfer, S.: IR-Deflektometrie. IR-Kamera-Workshops, Ettlingen, 15.3.2017 und 11.7.2017 Hoppe, A.H.; van de Camp, F.; Stiefelhagen, R.: Interaction with Three Dimensional Objects on Diverse Input and Output Devices: A Survey. International Conference on Human-Computer Interaction, Kanada, Vancouver, 9.-14.7.2017 Ihrig, R.; Kuny, S.; Thiele, A.; Hinz, S. (KIT): Analysis of Phenological Changes of High Vegetation in Amplitude Images of SAR Time Series. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 Kannegieser, E.: E-Learning A.I. for Simulations and Serious Games in Image Interpretation. Workshop on Artificial Intelligence, EDA, Belgien, Brüssel 31.5.2017 Kaufmann, I.: Aktive Sensorik für den Nahbereich. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheits-relevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 9.5.2017 Keßler, S.; Wittenstein, W.: ECOMOS Scientific Background: TRM4. EDA ECOMOS Workshop, Ettlingen, 21.6.2017 Kiefer, P.; Winkelmann, M.: Angular dependence of spectral reflection for different materi- als. SPIE Remote Sensing, Polen, Warschau, 10.-15.9.2017 Kippe, J.; Pfrang, S.: Network and Topology Models to Support IDS Event Processing. 3rd International Conference on Information System Security and Privacy ICISSP, Portugal, Porto, 18.-22.2.2017 Krieg, J.: Kurzwelliges Infrarot für Nachtsichtanwendungen – Beleuch- tungsniveaus und Sensorleistung. 9. DWT-Tagung, Optik und Optronik in der Wehrtechnik, Meppen, 25.-28.9.2017 Krause, J.: Benchmark mobile sensors; What is the ability of the new cheap consumer sensors? OCM-SpectroNet Collaboration Conference 2017, Karlsruhe, 21.3.2017 Kühnert, C.: Web-basierte Plattform für Condition Monitoring und Optimie- rung von Produktionsprozessen des Mittelstandes basierend auf maschinellen Lernverfahren. Forschungstag Baden-Württemberg Stiftung 2017, Stuttgart, 29.6.2017 Kühnert, C.: A Modular Architecture for Smart Data Analysis using Automa- tionML, OPC-UA and Data-driven Algorithms. ML4CPS-Machine Learning for cyber-physical-systems, Karlsruhe, 29.9.2017 Längle, T.: Optische Inspektion und Sichtprüfung. Institutsseminare des Fraunhofer IPMS, Dresden, 6.7.2017 1 5 9

162

LECTURES 2017 VORTRÄGE 2017 Längle, T.: Hyperspectral Imaging-Revolution oder Evolution in der industriellen Sichtprüfung? Seminar T.O.P. 2017-Technische Optik in der Praxis, Göttingen, 6.9.2017 Längle, T.: Ressourceneffizienz durch intelligente Sortierung. Forum auf dem Ressourceneffizenz-und Kreislaufwirtschaftskongress, Stuttgart, 19.10.2017 Längle, T.: Hyperspectral Imaging – Revolution oder Evolution in der indus- triellen Sichtprüfung? Fraunhofer VISION Technologietag 2017 und Jubiläumskongress 20 Jahre Fraunhofer Vision, Fürth, 26.10.2017 Längle, T.: Bildgewinnung bei der Oberflächenprüfung. Fraunhofer VISION- Seminar mit Praktikum: Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung, Karlsruhe, 5.12.2017 Lutzmann, P. - Gated-Viewing Systeme. - Laser Vibrometrie. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 10.5.2017 Lutzmann, P. Penetration of pyrotechnic effects with SWIR laser gated-viewing in comparison to VIS and thermal IR bands. 12th International ITBM&S Workshop (IR Target and Background, Modeling and Simulation), Ettlingen, 26.6.2017 Maier, A.: Prozessoptimierung und Predictive Maintenance durch Maschinelles lernen. 22. Industrial Communication Congress, Bad Pyrmont, 8.3.2017 Maier, A.: Use Cases für Big Data: Vorteile und Grenzen. Podiumsdiskussion auf der VDI-Tagung »Technische Zuverlässigkeit«, Leonberg bei Stuttgart, 17.5.2017 Maier, G.: Improving material characterization in sensor-based sorting by utilizing motion information. 3rd Conference on Optical Characterization of Materials (OCM 2017), Karlsruhe, 23.3.2017 Maier, S.; van de Camp, F.; Hafermann, J.; Wagner, B.; Peinsipp-Byma, E.; Beyerer, J.: The image interpretation workstation of the future: lessons learned. SPIE Conference on Defence and Commercial Sensing, USA, Anaheim, Kalifornien, 9.-13.4.2017 Meidow, J.; Förstner, W. (Institut für Geodäsie und Geoinformation, Universität Bonn): Utilizing the Uncertainty of Polyhedra for the Reconstruction of Buildings. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover Workshop), Hannover, 6.-9.6.2017 Meier, D.; Pfrang, S.: On the Detection of Replay Attacks in Industrial Automation Networks Operated with Profinet IO. 3rd International Conference on Information Systems Security and Privacy ICISSP, Portugal, Porto, 18.-22.2.2017 Meier, D.: Herausforderungen der industriellen IT-Sicherheit. BMU Strategie-und Expertenforum 2017, Einbeck, 4.-5.5.2017 Meier, D.: Entwurf und Einsatzszenarien eines Sicherheitslabors für Industrie 4.0. Erfahrungsaustausch Technologie: IT-Sicherheit im Industrie 4.0 Zeitalter, Kirchheim b. München, 30.5.2017 Meyer, J.: Plenoptische Bildaufnahme und –Auswertung zur automatischen Sichtprüfung transparenter Objekte. Regelungstechnischen Kolloquium 2017, Boppard, 16.-17.2.2017 Meyer, J.: fastGCVM: A Fast Algorithm for the Computation of the Discrete Generalized Cramér-von Mises Distance. 25th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2017 (WSCG 2017), Tschechien, Plzen, 1.6.2017 Meyer, J.: General Cramér-von Mises, a Helpful Ally for Transparent Object Inspection using Deflection Maps? 20th Scandinavian Conference on Image Analysis (SCIA 2017), Norwegen, Tromsø, 13.6.2017 Meyer, J.: Towards Light Transport Matrix Processing for Transparent Object Inspection. IEEE Computing Conference 2017, UK, London, 19.7.2017 Michaelsen, E.; Schwan, G.; Scherer-Negenborn, N.: Designing observer trials for image fusion experiments with Latin Squares. SPIE Defense + Commercial Sensing 2017, USA, Anaheim, Kalifornien, 10.-12.4.2017 Michaelsen, E.: Automatic Target to Background Discrimination by Hierarchical Gestalt Grouping. International IR Target and Background Modeling & Simulation Workshop ITBM&S, Ettlingen, 26.-29.6.2017 1 6 0

163

Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Dachsbacher, C.; Wörn, H.: Probabilistic Surface Inference for Industrial Inspection Planning. IEEE Winter Conference on Applications of Computer Vision 2017, USA, Santa Rosa, Kalifornien, 29.3.2017 Philipp, P.; Fischer, Y.; Beyerer, J.: Expert-based Probabilistic Modeling of Workflows in Context of Surgical Interventions. Conference on Cognitive and Computational Aspects of Situation Management CogSIMA 2017, USA, Savannah, Georgia, 27.-31.3.2017 Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Dachsbacher, C.; Wörn, H.: Image formation simulation for computer-aided inspection planning of machine vision systems. SPIE Optical Measurement Systems for Industrial Inspection X, Deutschland, München, 26.6.2017 Mohammadikaji, M.; Bergmann, S.; Irgenfried, S.; Beyerer, J.; Dachsbacher, C.; Wörn, H.: A Versatile Hardware and Software Toolset for Computer Aided Inspection Planning of Machine Vision Applications. International Conference on Information Systems Architecture and Technology 2017, Polen, Szklarska Poręba, 18.9.2017 Pak, A.: Measuring shape of a mirror with a moving camera. SPIE Optical Metrology, München, 26.6.2017 Peinsipp-Byma, E.: Rechnergestützte Satelliten- und Luftbildauswertung. Seminar FA 1.06 »Aufklärung mit moderner Sensorik« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 30.5.2017 Pethig, F.; Jasperneite, J.: Industrie 4.0-Kommunikation mit OPC UA Anwendungsfälle, Mehrwerte und Migrationsstrategie. 13. Fachtagung »Digital Engineering Technischer Systeme-Der Weg zur Smart Factory«, Magdeburg, 22.6.2017 Pethig, F.: Einfach anfangen mit dem Werkzeugkasten OPC UA. OPC UA in Anwendung-Infotag, Frankfurt a. M. 5.7.2017 Pethig, F.; Niggemann, O.: Towards Industrie 4.0 Compliant Configuration of Condition Monitoring Services. IEEE 15th International Conference on Industrial Informatics INDIN‘2017, Emden, 24.7.2017 Pethig, F.: IoT erleben – openAAS als Basis für Industrie 4.0. 2. VDI-Fach- konferenz »Intelligente Sensoren für Industrie 4.0 – Herausforderungen und Technologie im Spannungsfeld von Cloud und RetroFit«, Baden-Baden, 18.10.2017 Pfrang, S.: Entwurf und Einsatzszenarien eines Sicherheitslabors für Industrie 4.0. Erfahrungsaustausch Technologie: IT-Sicherheit im Industrie 4.0 Zeitalter, Kirchheim b. München, 30.5.2017 Pohl, M.; Meidow, J.; Bulatov, D.: Simplification of Polygonal Chains by Enforcing Few Distinctive Edge Directions. SCANDINAVIAN CONFERENCE ON IMAGE ANALYSIS (SCIA 2017), Norwegen, TROMSØ, 12.-14.6.2017 Renkewitz, H.: DEDAVE – ein autonomes Unterwasserfahrzeug für die Erkundung der Tiefsee. Forum Unmanned Vehicles IV, Bonn, 4.7.2017 Roller, W.; Pfisterer, D.: Serious Games als Framework für eine lehrgangsbegleitende Lernhilfe. DWT Tagung »Simulation in und für die Ausbildung«, Bad Godesberg, 7.-9.2.2017 Roller, W.: Synthetisches Apertur Radar – Grundlagen. Fachtechnische Grundlagen-Informationstechnik und Elektronik, BiZBw, Mannheim, 11.5.2017 Scharaw, B.: Urban Water Management. Agricultural University of Inner Mongolia, China, Hohhot, 23.-24.2.2017 Scharaw, B.: De-centralized Urban Water Management. L.N. Gumilyov Eurasian National University, Kasachstan, Astana, 3.5.2017 Schleipen, M.: Machine to Machine Communication in Industry 4.0 Environments. Global Smart Manifacturing Summit, Frankfurt a. M., 30.3.2017 Schulte, H.: Spektrale Messungen. Hausseminar der Firma Testo SE & Co. KGaA, Titisee-Neustadt, 11.7.2017 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE2.28 »Intelligente Sensorik I: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 22.6.2017 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs Grundlagen der Optronik, Bildungszentrum der Bundeswehr, Mannheim, 27.9.2017 1 6 1

164

LECTURES 2017 VORTRÄGE 2017 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE1.02 »Infrarottechnik-Grundlagen, Trends und moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 19.10.2017 Streicher, A.: Serious Games: Spielend leicht(er) lernen? Multimediawerkstatt, Studium Digitale, Goethe Universität Frankfurt a. M., 18.7.2017 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs SE2.14 »Radar-; VIS- und IR-Signaturen: Technik und Anwendung« der Carl-Cranz-Gesellschaft e.V., 29.11.2017 Schweitzer, C.; Wendelstein, N., Stein, K.: Infrared measurements of launch vehicle exhaust plumes. SPIE Security & Defence, Polen, Warschau, 10.-15.9.2017 Schweitzer, C.: The influence of the atmosphere on the performance of electro-optical systems-Measuring rocket exhaust plumes. Raum- fahrtprogramm REXUS / BEXUS-Workshop, DLR Oberpfaffenhofen, 20.-21.2.2017 Schweitzer, C.: Simulation of atmospheric and terrestrial background signatures for detection and tracking scenarios. ITBM&S, IOSB Ettlingen, 26.-29.6.2017 Schweitzer, C.: Messungen Kiruna 2017 und Hintergrundsimulation. Workshop Erweiterte Luftverteidigung-IR, Airbus Oberpfaffenhofen, 20.7.2017 Schweitzer, C.: Satellitenbasierte Frühwarnung-Detektion und Tracking von Flugkörpern. Workshop Hypersonische Flugkörper, INT Euskirchen, 17.8.2017 Sidorenko, J.; Scherer-Negenborn, N.; Arens, M.; Michaelsen, E.: Improved Linear Direct Solution for Asynchronous Radio Network Localization (RNL). ION Pacific PNT conference, USA, Honolulu, Hawaii, 1.-4.5.2017 Stojanovic, L.: Fog Computing: Herausforderungen und Möglichkeiten. Innovationstag »Cloud and Fog Computing« der IHK Reutlingen, Reutlingen, 3.7.2017 Stojanovic, L.: Intelligent edge processing. ML4CPS, Lemgo, 25.-26.10.2017 Streicher, A.: Web-basiertes Serious Game für Training im Verbund. LEARNTEC 2017, Karlsruhe, 24.-26.1.2017 Streicher, A.: Interoperable Adaptivity and Learning Analytics for Serious Games in Image Interpretation. IEEE ICE ITMC 2017, Portugal, Madeira, 27.-29.6.2017 1 6 2 Streicher, A.: Interoperable Adaptivity and Learning Analytics for Serious Games in Image Interpretation. EC-TEL 2017, Estland, Tallinn, 12.-14.9.2017 Streicher, A.: Application of Adaptive Game-based Learning in Image Interpretation. ECGBL 2017, Österreich, Graz, 4.-7.10.2017 Strentzsch, G.; van de Camp, F.; Stiefelhagen, R.: Digital Map Table VR: Bringing an Interactive System to Virtual Reality. International Conference on Human-Computer Interaction, Kanada, Vancouver, 9.-14.7.2017 Usländer, T.: Agiles Service Engineering mit der Methode SERVUC. GPM-Veranstaltung »System Engineering im Zeitalter des Industrial Internet und Industrie«, IOSB Karlsruhe, 19.1.2017 Usländer, T.: Industrie 4.0 and Smart Factories–Analysis and Implementation Strategies. 1st Smart Factory Conference, Griechenland, Athen, 22.2.2017 Usländer, T.: DIN Spec 16593 RM-SA–Referenzmodell für Industrie 4.0 Service- architekturen. Sitzung AG 1, Industrie 4.0, Ratingen, 14.3.2017 Usländer, T.: DIN Spec 16593: Referenzmodell für Industrie 4.0 Service Architekturen – Grundkonzepte einer interaktionsbasierten Architektur. DIN Forum, Hannover Messe Industrie, Hannover, 24.-28.4.2017 Usländer, T.: Establishing a secure web of smart factories-architecture, standards and technologies. Bitkom Innovation Forum, Hannover Messe Industrie, Hannover, 24.-28.4.2017 Usländer, T.: Agile Service Engineering – a key competence for Industrial Internet Applications. 8th International Workshop on Optimisation for Logistics and Industrial Applications IWOLIA, Frankreich, Troyes, 9.-10.5.2017 Usländer, T.: Smart Factory Web-an IIC Testbed on Production Market Places. Industry of Things World, Berlin, 18.-19.9.2017

165

Usländer, T.: IT Security in Industrie 4.0 Systemarchitekturen–wie lauten die Spezifika? IoT Security Strategiedialog, Frankfurt a. M., 26.-27.9.2017 Woock, P.; Beyerer, J.: Physically Based Sonar Simulation and Image Generation for Side-Scan Sonar. 4th Underwater Acoustics Conference and Exhibition (UACE) 2017, Griechenland, Skiathos, 4.-8.9.17 Wagner, B.; Maier, S.; Peinsipp-Byma, E.: Standardized acquisition, storing and provision of 3D enabled spatial data. SPIE Conference on Defence and Commercial Sensing, USA, Anaheim, Kalifornien, 9.-13.4.2017 Warnke, S.; Bulatov, D.: Variable Selection for Road Segmentation in Aerial Images. CMRT17 – City Models, Roads and Traffic 2017 (ISPRS Hannover Workshop), Hannover, 6.-9.6.2017 Watson, K.: IIC Testbed Smart Factory Web und Konsequenzen für das Projektmanagement. GPM-Veranstaltung System Engineering im Zeitalter des Industrial Internet und Industrie, IOSB Karlsruhe, Karlsruhe, 19.1.2017 Wuttke, S.; Middelmann, W.; Stilla, U. (TU München): Improving active queries with a local segmentation step and application to land cover classification. CMRT17-City Models, Roads and Traffic 2017 (ISPRS Hannover Workshop), Hannover, 6.-9.6.2017 Zaschke, C.: Adaptation of interoperability standards for cross domain usage. SPIE Defense + Commercial Sensing 2017, USA, Anaheim, Kalifornien, 9.-13.4.2017 Ziebarth, M.; Stephan, T.; Höfer, S.; Burke, J.: Mustererzeugung zum Phasenschieben durch Rotation für die Deflektometrie. Jahrestagung DGaO, Deutschland, Dresden, 7.6.2017 Watson, K.: Establishing a secure web of smart factories - architecture, standards and technologies. Industry 4.0 for Plastics Processors 2017, Köln, 7.3.2017 Ziehn, J.: Recent Automated Driving Developments. KSS Research Workshop, Karlsruhe, 21.-22.9. 2017 Watson, K.: Smart Factory Web. IIC Quarterly Meeting, USA, Reston, Virginia, 20.-24.3.2017 Ziehn, J.: Wie entscheidet das Fahrzeug für uns? Profilregion-Seminarreihe: Der Weg zum Autonomen Fahren, Karlsruhe, 17.10.2017 Watson, K.: Smart Factory Web with OPC UA and Automation ML. Smart Factory EXPO, OPC Day Korea, Südkorea, Seoul, 29.-31.3.2017 Watson, K.: IIC Testbed Smart Factory Web. Steinbeis Engineering Tag, Stuttgart, 5.4.2017 Watson, K.: AutomationML - Industrie 4.0 Candidate Standard for Asset Model Engineering and Plug & Work. Internet of Things and Model based Engineering in Manufacturing, Belgien, Brüssel, 7.6.2017 Welte, A.; Hammer, H.; Thiele A.; Hinz, S. (KIT): Building Change Detection in Time Series of TanDEM-X Interfe- rograms. SPIE Remote Sensing 2017, Polen, Warschau, 11.-14.9.2017 Willersinn, D.: Resilientes kooperatives Fahren im Mischverkehr. Forum Elektromobilität, Berlin, 2.6.2017 Willersinn, D.: Autonomes Fahren am Fraunhofer IOSB. 5. Netzwerktreffen FutureCar, München, 25.-26.7.2017 1 6 3

169

Photo acknowledgements Cover, Page 2, 7, 11, 30, 32, 54/55, 62, 76, 82/83, 84 above, 86 above, 90/91, 90/91, 92/93, 94, 95, 96/97, 102, 104/105, 106/107, 108/109 above, 110/111, 112, 114/115 above, 116/117 above, 118/119, 120: indigo - Studio für Werbefotografie photographer: Manfred Zentsch Page 23 above: Depositphotos Inc., USA Page 46/47 above, 123, 129: MEV All other images: Fraunhofer IOSB E D I T O R I A L N O T E S I M P R E S S U M Published by Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB Director: Prof. Dr.-Ing. habil. Jürgen Beyerer Editor Ulrich Pontes Layout Christine Spalek Proofreading BBK Gesellschaft für moderne Sprachen mbH 76726 Germersheim Printed by Kraft Premium GmbH 76275 Ettlingen Editorial Deadline April 2018 Contact: Fraunhofer IOSB Press and Communications Fraunhoferstraße 1 76131 Karlsruhe Phone +49 721 6091-300 Fax +49 721 6091-413 publikationen@iosb.fraunhofer.de All rights reserved. Reproduction of any material is subject to edito- rial authorization. © Fraunhofer IOSB Karlsruhe 2018 Institute of the Fraunhofer Gesellschaft, Munich 1 6 7

170

A D R E S S E S A D R E S S E N Karlsruhe Fraunhoferstraße 1 76131 Karlsruhe Telefon +49 721 6091-0 Fax +49 721 6091-413 info@iosb.fraunhofer.de www.iosb.fraunhofer.de Leitung Prof. Dr.-Ing. habil. Jürgen Beyerer Telefon +49 721 6091-210 juergen.beyerer@iosb.fraunhofer.de Presse und Kommunikation Dipl.-Phys. Ulrich Pontes Telefon +49 721 6091-300 ulrich.pontes@iosb.fraunhofer.de Verwaltung Dipl.-Kaufm. Siegbert Böckle Telefon +49 721 6091-350 siegbert.boeckle@iosb.fraunhofer.de Ettlingen Gutleuthausstraße 1 76275 Ettlingen Telefon +49 7243 992-0 Fax +49 7243 992 298 Leitung Bereich Photonik und optronische Systeme Prof. Dr. rer. nat. habil. Marc Eichhorn Telefon +49 7243 992-131 marc.eichhorn@iosb.fraunhofer.de Institutsteil Angewandte Systemtechnik AST Am Vogelherd 50 98693 Ilmenau Telefon +49 3677 461-103 Fax +49 3677 461-100 steffi.nothnagel@ iosb-ast.fraunhofer.de www.iosb-ast.fraunhofer.de Außenstelle Görlitz, Abteilung Energie Brückenstraße 1 02826 Görlitz Telefon +49 3581 79255354 joerg.laessig@iosb-ast.fraunhofer.de Leitung Prof. Dr.-Ing. habil. Thomas Rauschenbach Institutsteil für industrielle Automation INA Langenbruch 6 32657 Lemgo Telefon +49 5261 702-5998 Fax +49 5261 702-5969 sek-ina@iosb.fraunhofer.de www.iosb-ina.fraunhofer.de Leitung Prof. Dr.-Ing. Jürgen Jasperneite Telefon +49 3677 461-124 Telefon +49 5261 702-572 thomas.rauschenbach@ iosb-ast.fraunhofer.de juergen.jasperneite@ iosb-ina.fraunhofer.de 1 6 8 Fraunhofer Representative Office Beijing Representative for Production and Information Technologies Unit 0610 Landmark Tower II 8 North Dongsanhuan Road Chaoyang District 100004 Beijing PR China Dipl.-Ing. Hong Mu Telefon +86 10 65900 621 Fax +86 10 65900 619 muh@fraunhofer.com.cn Social-Media-Kanäle twitter.com/FraunhoferIOSB facebook.com/FraunhoferIOSB linkedin.com/company/fraunhofer-iosb s.fhg.de/Youtube-IOSB KARLSRUHEETTLINGENILMENAULEMGOGÖRLITZ

172

FRAUNHOFER-INSTITUT FÜR OPTRONIK, FRAUNHOFER-INSTITUT FÜR OPTRONIK, SYSTEMTECHNIK UND BILDAUSWERTUNG IOSB SYSTEMTECHNIK UND BILDAUSWERTUNG IOSB KARLSRUHE KARLSRUHE FRAUNHOFERSTRASSE 1 FRAUNHOFERSTRASSE 1 76131 KARLSRUHE 76131 KARLSRUHE TELEFON +49 721 6091-0 TELEFON +49 721 6091-0 ETTLINGEN ETTLINGEN GUTLEUTHAUSSTRASSE 1 GUTLEUTHAUSSTRASSE 1 76275 ETTLINGEN 76275 ETTLINGEN TELEFON +49 7243 992-0 TELEFON +49 7243 992-0 ILMENAU ILMENAU INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AM VOGELHERD 50 AM VOGELHERD 50 98693 ILMENAU 98693 ILMENAU TELEFON +49 3677 461-0 TELEFON +49 3677 461-0 GÖRLITZ GÖRLITZ INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) INSTITUTSTEIL ANGEWANDTE SYSTEMTECHNIK (AST) AUSSENSTELLE GÖRLITZ AUSSENSTELLE GÖRLITZ ABTEILUNG ENERGIE ABTEILUNG ENERGIE BRÜCKENSTRASSE 1 BRÜCKENSTRASSE 1 02826 GÖRLITZ 02826 GÖRLITZ TELEFON +49 3581 7925354 TELEFON +49 3581 7925354 LEMGO LEMGO INSTITUTSTEIL FÜR INDUSTRIELLE AUTOMATION (INA) INSTITUTSTEIL FÜR INDUSTRIELLE AUTOMATION (INA) LANGENBRUCH 6 LANGENBRUCH 6 32657 LEMGO 32657 LEMGO TELEFON +49 5261 94290-22 TELEFON +49 5261 94290-22 WWW.IOSB.FRAUNHOFER.DE WWW.IOSB.FRAUNHOFER.DE

Table of Content

Preface

Autonomous underwater vehicles

Modular Drone Detection and Assistance System

Cybersecurity Training Lab

ML4P - Machine Learning for Production

Farewell to Dr. Reinhard Ebert

The Institute in Profile

Business Units

Automation

Energy, Water and Environment

Visual Inspection

Defense

Security

Core Competences and Department Portfolios

Optronics

System Technologies

Image Exploitation

Appendix: Names, Dates, Events

Advisory Board

Honors and Awards

Patents and Trademarks

Scientific Publications