Since 2007, I have worked on countless personal and academic software projects. I’m in the process of updating this site to showcase some more recent projects.
Medical NLP: Effective Querying in Medical Case Databases
In this project, we introduce a new product to accelerate the adoption of AI in Health Care. In cooperation with the MGH & BWH Center for Clinical Data Science, we applied and optimized natural language processing methods for dealing specifically with medical patient reports collected in hospitals. Reports are written in free form and pose special challenges, such as use of highly specialized vocabulary, abbreviations, typing errors and negated sentences. Standard approaches towards extracting key information or querying, while working well in general use cases, typically fail miserably on these kind of data. We developed a highly efficient search engine for medical databases that helps (i) clinicians to retrieve relevant cases, aiding both clinical diagnostics and treatment, and (ii) machine learning engineers working in the healthcare domain, looking towards automatic extraction of relevant train and test data.
Orbital Trajectory Fitting: Detecting Near-Earth Asteroids
This report summarizes a multi-step method for identifying full orbit trajectories of asteroids in our solar system. The input to this method is a list of partial ”tracklets,” a series of visible-light observations of an object in the night sky over the course of several hours. The output is a series of ”orbital elements” that completely define the asteroid’s trajectory through our solar system. Some steps of this method have been completed as a prior project and are outside the scope of this paper; specifically, (i) the partitioning of the night sky into 768 spatial regions and monthly time windows, and (ii) the initial clustering of asteroids within those regions/windows into ”asteroid slices”. The steps that are within the scope of this paper are (a) the optimization of the six ”motion parameters” of each cluster from a variety of optimization solvers, (b) performing refinements on the earlier clusters using the optimized motion parameters, (c) converting the motion parameters into time independent ”orbital elements,” and (d) meta-clustering the asteroid slices from different time/space windows into final asteroid trajectories. Ultimately, our algorithm correctly identifies 69.9% of just over 21,000 asteroids in a labeled dataset with an approx. 1% error rate of spurious asteroids. We hope to run this algorithm on a full, unsolved database of asteroids known as the Isolated Tracklet File (ITF).
Video Generation: Using FCNs in an Adversarial Setup
In this project, we present a variety of deep learning based setups for text-to-image and text-to-image sequence generation. Image sequence generation is a challenging task and an actively researched branch within computer vision, posing special challenges such as temporal coherency. To address this problem, we describe a variety of partial and complete solutions that we developed in three stages: (1) Text to Image Synthesis: using a traditional GAN, we generate a single image from a textual representation. (2) Text + Image to Video Synthesis: using a fully convolutional network, we generate an image sequence given a single frame and a description of the action taking place. (3) Inspired by the recent success of generative adversarial networks, we then also train this architecture in a truly adversarial setting. Throughout our work, we make use of different datasets. Primarily, we evaluated our approaches on our own synthetic datasets with increasing difficulty, then moving to natural images from a human action dataset. We also performed text to image synthesis experiments on the T-GIF dataset, but noticed that the high diversity and other issues with this dataset make it rather unsuitable for video generation experiments.
Semantic Segmentation: Investigating Multiscale Class Activation Mapping
In this paper we apply Class Activation Mapping (CAM) to the problem of car detection. For this, we perform weakly-supervised training of different Convolutional Neural Networks on large-scale datasets depicting cars and evaluate them on artificial and realistic image data. To detect also small object appearances, we combine CAM with a multiscale sliding window approach. We show that (i) the usage of CAM improves localization ability compared to the aggregation of results by a simple sliding window classifier considerably, and (ii) our multiscale sliding-window extension enhances the quality of localization results when focusing on small object appearances by increasing mapping resolution, although increasing computational costs. The presented car detector is robust and performs well on both artificial and challenging realistic data, achieving a F1-score of 0.82 or 0.77 in our metric, respectively.
EasyFileTransfer: File Sharing for Local Networks (2014)
- Developed file sharing solution for local networks.
- Designed for simple user experience, features Metro-style system overlay for easy access.
- Supports sharing of files and directories, screen and clipboard content.
CLFlow: Cluster Management for TensorFlow (2017)
- Developed software to create software-managed computing clusters to parallelize heavy computing tasks on inexpensive hardware setups.
- Software supports automatic job distribution, dataset synchronization, live training supervision and administration using central master node.
- Deployed in research lab, significantly aided multiple research projects.
ANN.NET: A Neural Network Toolkit for .NET (2015)
- Toolkit for training and simulating arbitrary feedforward neural networks in .NET.
- Graphical visualizations tools, e.g. of network structure, training procedure and weights.
- Extensive benchmarking and configuration options in user interface.
- Basic implementation of self-organizing maps (SOMs) for unsupervised learning.
- Library provides extensive options for configuration.
- Various visualization features.