Research Engineer (m/f/div)

The Optics & Sensing Laboratory (OSLab) at the Max Planck Institute for Intelligent Systems in Tübingen, Germany, has an open position for a Research Engineer to lead the development of the Non-verbal Interpersonal Communication Exploration (NICE) Toolbox. The lab supports the creation of highly realistic human and animal avatars for use in research, film, virtual reality, biology, and medicine. By utilizing advanced 3D & 4D capture facilities, machine learning, computer vision, and cutting-edge graphics, the lab models the shape and behavior of humans and animals. The NICE Toolbox project aims to develop software that assists non-computer scientists in exploring non-verbal communication by detecting visual movements and behaviors of humans in videos, ultimately contributing to a better understanding of social interactions and communication patterns.

Roles & Responsibilities

The research engineer will lead the development and extension of the non-verbal interpersonal synchrony communication exploration toolbox. This position involves collaboration with industry researchers and computer vision engineers. The candidate should have strong skills in software design and development, along with experience in computer vision and machine learning.

The responsibilities include leading the following project areas:

1. Development, support, and application of an open-source computer vision software toolbox: https://github.com/OSLabTools/nicetoolbox.
2. Extending the software for human-to-avatar communication, including creating data assets and conducting experiments for comparison and analysis.
3. Engaging in new and existing collaborations with researchers and practitioners in psychology, psychotherapy, social machine learning, and related fields.

Key tasks include:

• Maintaining, extending, and testing the developed software, including the use of continuous integration (CI).
• Enhancing body tracking, facial expression, and gaze intersection algorithms.
• Developing evaluation pipelines and tools in computer vision and data processing.
• Publishing open-source datasets and software tools for the scientific community.
• Developing novel systems to record data on human-to-avatar communication.
• Supporting the development of communication quality analysis tools through collaborations with research and industry partners.
• Overseeing and assisting student assistants involved in the project.
• Contributing to grant writing and applications to extend the project beyond its initial one-year duration.

Education & Experience

The ideal candidate will have:

• A PhD degree or an MSc with a strong academic background in computer vision and machine learning.
• Proficiency in programming languages such as Python, CMake, OpenCV, PyTorch, Streamlit, and ReRun.
• Experience with deep learning frameworks.
• Familiarity with data acquisition from sensors, such as biofeedback, IMUs, pressure sensors, and eye-trackers.
• Knowledge of software engineering practices, including continuous integration, unit testing, OOP, and Git.
• Strong oral and written communication skills in English.
• A team-oriented, detail-focused mindset.

Their Offer

The position provides:

• The opportunity to work on a multidisciplinary collaborative project at the Max Planck Institute for Intelligent Systems in Tübingen.
• Access to cutting-edge technologies related to computer vision and multi-sensor systems.
• A dynamic and motivating work environment with international scientists, engineers, and administrative staff.
• A salary in accordance with the collective agreement for the public sector (TVöD Bund) and the federal pay scale (TV EntgO-Bund), based on qualifications.
• A subsidy for the Deutschland-Jobticket (ÖPNV).
• Support for family life with connections to a daycare center and the option for mobile working.
• A one-year contract with the possibility for extension.

Application

Candidates are invited to upload their application, including:

• A one-page motivation letter explaining why they are a strong fit for the position.
• A curriculum vitae with three listed references.
• A GitHub account showcasing programming skills.

Applications should be submitted via the institute's application portal.

For any questions regarding the position, candidates can contact Dr. Senya Polikovsky at senya.polikovsky@tuebingen.mpg.de or Dr. Keiko Kitagawa at keiko.kitagawa@tuebingen.mpg.de.

The Max Planck Society is committed to increasing the number of individuals with disabilities in its workforce and encourages applications from qualified individuals. The society strives for gender equality and diversity and specifically encourages women to apply for roles where they are underrepresented.