Contributions to Open Research

• - Highlighting the work of SOTA reseachers & practitioners who publish code, models, app & notebooks (in some cases) for a paper

• - ML Concepts explained in under a minute with accompanying notebook and notebook code walkthrough

• - Discover and compare SOTA solutions for tasks with a few keystrokes/clicks

• - Free APIs for tasks using SOTA models (with permissive licenses). Please use for evaluation only to avoid overwhelming servers

• - demo apps hosted on TWC servers and/or on Hugging Face

• - notebooks in Google colab

• - Github repos with experiments that are work in progress

• - Aperiodic newsletters on Ghost and Medium

Tasks solved using SOTA models

1. Image background removal - API available now
2. Video background removal
3. Classifying the dominant object in the foreground of an image
4. Detecting multiple objects within an image
5. Image Captioning
6. Video quality assessment
7. Learning image embeddings
8. Sentence embeddings for Semantic search, similarity, and clustering
9. Exploratory tasks

Image Background Removal

Current endpoint

• for Image background removal. API usage illustrated in &

SOTA model for this task

• InSPyReNet fork
  • &
  • Evaluate in Colab

Video Background Removal

Current endpoint

• Notebook

SOTA model

• InSPyReNet fork
  • Evaluate in Colab

Foreground object classification

Current endpoint

• Compare two model outputs (SimMIM & VIT base) in Colab
  • Classifies input image into one of 1000 classes

SOTA model

• SimMIM fork
  • Evaluate in Colab

Detecting multiple objects within images

Current endpoint

• Compare models through separate apps (Detic & OWL-ViT)
  • . Detic Model
  • OWL-ViT model

SOTA models

• GRiT fork
  • Evaluate in Colab

Image Captioning

• OWL-ViT model

SOTA models

• GRIT fork Evaluate in Colab

Video quality assessment

• DOVER fork Evaluate in Colab

Self-supervised image representations

• MAE fork Evaluate in Colab

Sentence embeddings

Tasks

• Sentence Similarity Comparison app &
• Semantic Search Comparison app &
• Semantic Clustering Comparison app &

SOTA models

• SimCSE fork - 👨‍💻 for use in comparison app
• SGPT fork - 👨‍💻 for use in comparison app
• DCPCSE fork - 👨‍💻 for use in comparison app
• OpenAI embeddings wrapper 👨‍💻
• 🤗 Hugging Face models wrapper 👨‍💻 for comparison app

Exploratory tasks

• Latent Diffusion fork with Colab notebook
• Taming Transformers fork with Colab notebook