Visualising NLP pipelines with Pynorama

on YouTube ↗34m

" summary

A Python visualization system called Pynorama (Panorama) visualizes whole NLP corpora, metadata and model pipelines, not just one chart. It ships as a Flask backend and React/Redux frontend, supports a pandas data-frame backend or a MongoDB backend for scale, and uses lazy node evaluation with optional Spark runs. Demo shows ~10,000 Reuters articles, a confusion-matrix workflow, and an intern-built open-source repo created over a summer.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 1:12What we aim to achieve with Pynorama
3. 3:03NLP pipeline challenges
4. 8:16Pynorama features
5. 11:08Live demo
6. 16:58Integrating Pynorama
7. 17:19Pynorama API
8. 28:22Pynorama open source
9. 29:23Contributing to Pynorama
10. 31:30Q&A

" related talks

• 35mUsing Scattertext and the Python NLP Ecosystem for Text VisualizationJason Kessler · PyData Seattle 2017
• 35mUnderstanding the News around the World with Web Scraping and NLP at ScaleJon Wiggins · PyData NYC 2022
• 28mAdvanced Graph Visualizations in Jupyter NotebooksBenjamin Niedermann · NODES 2024
• 15mVisualizing Data Analysis Pipelines with Pandas Tutor and Tidy Data TutorSean Kross · posit::conf(2023)
• 35mUntitled12.ipynbVincent D Warmerdam · PyData Eindhoven 2019
• 53mApache Deep Learning 302Timothy J Spann · ApacheCon@Home 2021
• 45mArchitecture of an NLP DeploymentMichele Casbon · QCon São Paulo 2018
• 21mFrom 0 to a crowd sourced neural network in a jiffyJess Alfredsen, Sebastian Steenssøn · Data Science Conference 5.0