Research Projects

Clinical NLP

The rapid adoption of Large Language Models (LLMs) in healthcare has opened new possibilities for automating complex tasks. However, LLMs often struggle with the nuanced demands of the biomedical domains. This gap between general-purpose capabilities and domain-specific requirements motivates a deeper investigation into how LLMs can be adapted to clinical applications.

Blood Films

Peripheral blood film (PBF) screening is a cornerstone of hematological diagnostics, enabling the identification of conditions ranging from anemia to acute leukemia. Manual microscopy (MM), the current gold standard, is labor-intensive and subject to inter-observer variability. The use of machine learning in the workflow enables more effective and efficient assessment of peripheral blood films.

Profiling

Understanding the demographics, preferences, and affective states of people will be highly beneficial for commerce, urban safety, security, and many other areas. Multimodal profiling analytics (MMPA) aims to recognize individuals’ attributes. We consider multiple long-term attributes (age, gender, ethnicity, personality type) together with short-term or transient attributes (gait/posture, affect, attention, fatigue, engagement), using both explicit and subtle cues detected via multiple sensor modalities.

Cloud Imaging

Cloud and rain attenuation affect satellite communication, especially at high frequencies. We use images from low-cost ground-based camera systems to analyze cloud cover and its properties, with the aim of developing a cloud attenuation model that is location-specific and time sensitive.

Photowork

Ubiquitous and affordable digital cameras have enabled users to take pictures and videos everywhere and anytime. Photowork, i.e. assessing, selecting, editing, organizing, and annotating this large amount of visual data, is tedious and time-consuming, as it involves a lot of manual labor with only minimal basic computational support available to users. This project aims to address major gaps and challenges in automating photowork, with a particular focus on large content collections.

Visual Quality

Lossy compression methods for visual information in digital form introduce distortions whose perceptibility highly depends on scene content. Measuring the subjective visibility of these artifacts accurately and reliably is difficult. The focus of our research is on metrics for video quality assessment.

Soccer Analysis

We are developing a system for real-time automated analysis of soccer video using novel computer vision and machine learning techniques. The analysis includes tracking players and the ball as well as the detection and recognition of important soccer events and activities.