Dental AI Diagnostic Assistant & Clinical Tools

AI and Computer Vision Engineer at Smartory Labs

Role and Mission Overview

At Smartory Labs, clinical AI tools were engineered for automated dental radiograph diagnosis, at-home treatment follow-up, and daily oral hygiene monitoring using smartphone cameras.

Mar. 2023 to Sep. 2024 Istanbul, Turkey

Automated Dental Radiograph Diagnosis

The Challenge

Subtle early-stage cavities, hidden restorations, and overlapping anatomy in dental radiographs often present significant diagnostic challenges during rapid chairside evaluation.

Clinical Data Operations & Dataset Curation

Spearheaded end-to-end data gathering and multi-stage annotation protocols across 100,000+ radiography images in close collaboration with over 20 dental specialists, establishing high-quality ground truth benchmarks for detection, segmentation, and classification.

The Solution and System Architecture

A two-stage deep learning diagnostic pipeline was engineered: an initial model detects individual teeth and update their profile in the application, after which a secondary model crops each tooth to diagnose defects. Diagnostic flags are generated for subtle abnormalities, providing clinicians with an automated chairside second opinion.

Dental Radiograph Original (Before)
Dental AI Detections (After)
AI Detection (After) Original (Before)
60%+
Hidden Cavity Catch
Detects subtle interproximal cavities and restorations
> 90%
Automated Profiling Accuracy
Update tooth with every new image
Instant
Chairside Output
Generates complete radiographic report in seconds
Multi-Modality Radiographic Analysis

High-resolution clinical demonstrations across complementary radiographic modalities:

Bitewing Modality AI Detection
Bitewing Interproximal Defect Detection

Targeted bounding box localization of hidden interproximal caries, marginal bone level changes, and sub-surface restorations.

Panoramic Modality AI Segmentation
Full-Arch Anatomical Segmentation

Multi-class semantic segmentation identifying individual dental numbering, alveolar bone contours, and mandibular nerve canals across panoramic scans.

Smartphone Hygiene Monitoring and Patient Profiling

The Challenge

Post-treatment follow-up and preventative oral hygiene tracking between clinical appointments have traditionally been hindered by arbitrary camera angles, inconsistent lighting, and lack of continuous monitoring tools.

The Solution and System Architecture

A mobile computer vision pipeline was developed alongside a custom-designed physical smartphone holder to standardize camera alignment and illumination during at-home imaging. The system was designed for treatment follow-up and daily oral hygiene monitoring, allowing longitudinal patient profiles to be tracked and updated automatically.

Daily
Hygiene Monitoring
Continuous post-treatment tracking between visits
Hardware
Custom Phone Holder
Standardized camera alignment and illumination
Automated
Patient Profiling
Structured historical tracking for clinician review

AugmenTory Open-Source Polygon Library

The Challenge

Instance segmentation models require extensive data augmentation, yet traditional raster mask tools consume excessive memory and introduce substantial throughput bottlenecks during high-resolution dental imaging training.

The Solution and System Architecture

AugmenTory was conceived and released as an open-source Python library for native vector polygon transformations. By executing geometric calculations directly on coordinate vertices instead of pixel masks, spatial memory overhead was reduced to 1.2% while accelerating training batch generation by 1.7x.

Vector Polygon Augmentation & Crop Pipeline:
Stage 1: Raw Radiograph Original
AugmenTory Dental Original Annotations
Multi-Object Ground Truth
Full field-of-view with raw vector polygon annotations for restorations (blue) and caries (red).
Stage 2: Affine Transform Augmented
AugmenTory Dental Affine Rotation & Crop
Rotation, Scale & Crop
Vector vertices recalculated directly in coordinate space under rotation and translation, automatically clipping boundaries without pixel mask rasterization.
Stage 3: Sub-Pixel Crop Augmented
AugmenTory Dental RoI Tooth Crop
Isolated Tooth Region (RoI)
High-resolution localized zoom preserving exact sub-pixel polygon contours and eliminating degenerate sliver vertices.
98.8%
Memory Overhead Cut
Operates purely on vector polygon vertices
1.7x
Faster Training Pipelines
Eliminates pixel-mask rasterization bottlenecks
Open Source
Python Library
Publicly available on PyPI & GitHub

Technologies, Publications & Open Source

PyTorch CNN Instance Segmentation YOLOv8 Qwen LLMs & Multimodal AI AugmenTory OpenCV FastAPI Medical Imaging
Research Publications
Open Source & Deep-Dives
AugmenTory Python Library
High-performance vector polygon coordinate transformation on PyPI & GitHub
View GitHub Repository
AugmenTory Project Deep-Dive
Interactive coordinate visualizer and sub-pixel polygon benchmarks
Explore Framework Page