I Think It’s a Kitten Wearing a Bowtie? Drupal Caption Suggestions
summary
Proof of concept integrates the IBM image captioning API with Drupal Media to auto-generate alt text and captions, returning three caption options with probability scores; code is a custom module + Library + JS widget that calls a Drupal controller which calls IBM, parses JSON and optionally populates the image field. Model is Show-and-Tell (Inception‑v3 encoder + LSTM decoder), dataset ~500k images skewed to nature, works well for landscapes but gives glaring errors for uncommon subjects.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:47Why use AI captions
- 4:56Background about the model
- 6:44What is the model
- 7:53Deep convolutional neural network
- 9:16Recurrent neural network
- 10:55Data set
- 12:55AI captions
- 14:36Conclusion
- 19:49Field Enhancements
- 25:55Field Widget
- 39:12Cost
related talks
01h 00mAI and alt text
11mAI-powered JavaScript applications
23mMargaret Mitchell, Senior Research Scientist, Google at MLconf Seattle 2017
54mKeyboards? Where We’re Going, We Don’t Need Keyboards
24mChaining, Smithing, and Graphing LLMs on Google Cloud
11mCan a robot code my website?
10mAI Powered Strapi Optimizing Content Workflows
01h 00mThe Future of Content: Context-Aware, Centralized, and Written by Robots