~/talk

Code Generation in Serializers and Comparators of Apache Flink

on YouTube 35m
Talkat Flink Forward Berlin 2016 · 2016-09-12..09-14· [data-engineering, compilers-and-language-design]

speaker

name:Gabor Horvath
links:none on file

resources

video:https://youtu.be/uscx9MrSKWY
slides:none on file

summary

Runtime code generation produces specialized POJO serializers and comparators that remove reflection, avoid boxing, and unroll field loops, delivering up to 6x faster serialization and about 20% end-to-end speedup on real Flink jobs (handwritten POJO serializers earlier gave ~10% and some cases reach ~30%). Generation uses Janino and Freemarker, ships source with a wrapper so remote JVMs recompile, and resolves tricky classloader caching by invalidating caches when user classloaders change.

AI-written summary · about

chapters (12)

  1. 0:00Intro
  2. 0:32PARADIGM SHIFT IN BIG DATA FLATFORMS
  3. 1:30SERIALIZATION IN FUNK
  4. 5:09SEVERAL SERIALIZER RELATED INNOVATIONS IN APACHE LINK
  5. 6:05RUNTME CODE GENERATION
  6. 7:24QUESTIONNAIRE
  7. 9:24NINE MEN'S MORRIS BENCHMARK
  8. 14:03HOW DOES THIS WORK
  9. 20:31LET'S TRY IT OUTI
  10. 24:58WHAT'S NEXT
  11. 27:07DISTANT FUTURE
  12. 28:13CONCLUSION

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.