experiments.swm.cc
indexatron

API Integration

View PR
pythonapiproduction

Production integration with the-mcculloughs.org Rails app.

Changes

  • API client for fetching pending uploads and posting results
  • Context-aware prompting with metadata injection
  • Family nickname resolution (aliases to real names)
  • Era override from actual date_taken
  • Safety filters for inappropriate terms
  • Category limits to prevent repetition loops
  • CLI with --shortcode for reprocessing
  • Image resizing and WebP to JPG conversion

Model Comparison

Tested LLaVA 7b vs Llama 3.2 Vision:

AspectLLaVA 7bLlama 3.2 Vision
Speed~27s/image~60s+/image
JSON OutputMostly validOften malformed
Schema AdherenceReliableRepetition loops
Context FollowingGoodVariable

LLaVA 7b proved more reliable for structured extraction.

Results

The service is now in production, automatically processing photos uploaded to the-mcculloughs.org.

See the full write-up for details on context-aware prompting.