Date & Time
- 28rd May 2016
- 3:00pm to 5:30pm
C.I.T Campus, 4th Cross Street,
Location map: https://goo.gl/maps/iRsY81X8d9p
- Introduction to PySpark (20 min)
- Introduction to Celery (20 min)
- Networking Tea Break (30 min)
- Code Optimisation in Python (20 min)
- OPEN TALK SLOT (20 min)
- Lightning Talks (20 min)
- Discussion (20 min)
Introduction to PySpark
- Spark concepts
- Python functional programming constructs
- map, reduce, filter etc
- pySpark programming - with some examples.
Introduction to Celery
Cases when number of tasks are submitted to task queue which needs to be processed asynchronously Celery saves the day. Celery distributes and coordinates the tasks over multiple workers (may be running on different machine). It also scales well with addition/removal of workers on the fly to handle those occasional burst work load between long periods of calm.
With the flexibility to support multiple message brokers and custom extension for various modules it addresses a wide variety of retirements.
Code Optimization in Python
I am referring to the following 2 links. They have some good material.