Using GUI Automation to Create APIs for API-less Desktop Apps
summary
Demonstrates using PyAutoGUI to control mouse and keyboard and build a real Python wrapper for a GUI-only app, turning Posterazor into a usable Posterazor API module. Shows exact techniques: pixel color checks, keyboard navigation instead of XY clicks, window resizing and percent-based coordinates, using screenshots or OpenCV fuzzy matching, and the fail‑safe mouse corner to stop runaway loops. The module works on the presenter's laptop and automates the five-step Posterazor export reliably.
AI-written summary · about
chapters (9)
- 0:00Introduction and background
- 1:32Why create GUI automation
- 3:57Introducing PyAutoGUI
- 7:00Real-world use cases
- 10:08Benefits of GUI automation
- 11:52Case study: Posterazor
- 15:01Tips and best practices
- 21:14Philosophy of messy code
- 22:42Q&A and conclusion
related talks
39mAutomating Your Browser and Desktop Apps
33mAutomating Your Browser and Desktop Apps
30mBuild GUIs with Python and Glade
25mHow to build a cross platform GUI app with Python
28mHow to build a cross-platform graphical user interface with Python
47mHow to build a cross platform GUI with Python
22mLow-code Interfaces with Qt and Their Integration with Python
27mQtQuick and Python used for a Robotics UI