We invite you to join us on August 21-22 for a workshop for current and potential users and developers of the
Scenic probabilistic programming language for world modeling and data
generation for AI-based autonomy.
The workshop will be hosted at UC Santa Cruz, and will include food and housing from dinner on August 20 through
lunch on August 22; virtual attendance options are also available. The workshop will provide hands-on tutorials on
programming in the Scenic language, how to interface it to your simulator of choice, how to extend Scenic with new
features, and on Scenic's use cases for testing, debugging, synthetic data generation, etc. We will also have a
session on industrial applications and breakout groups on topics of special interest such as Scenic's internals
and application domains including autonomous driving and robotics. The schedule is summarized below:
August 21: tutorials on how to use and extend Scenic; evening reception
August 22: industry session; working groups and breakout sessions on advanced topics
Autonomous Vehicles
Robotics
Aviation
Reinforcement Learning
Augmented Reality
Today's autonomous systems rely heavily on the use of machine learning components trained on large amounts of data. Even so, it is expensive to collect relevant data and test these systems in the real world in a manner that captures typical data distributions and also covers edge cases. Therefore, simulators are widely adopted in the robotics and computer vision community to train, test, and debug autonomous and semi-autonomous systems. However, working directly with simulators can be too low-level and problem-specific. To support the design lifecycle of autonomous/semi-autonomous systems, one needs to raise the level of abstraction above individual simulators and provide a formal framework for world modeling. Such a world model can help reason about the safety of a system and facilitate data generation and sim-to-real validation, as well as help to interpret, validate, share, or re-use training and test scenarios across the community.
The objective of this tutorial is to introduce Scenic, an open-source, domain-specific probabilistic programming language for world modeling that addresses the above needs. Scenic is designed to model and generate interactive (or reactive), multi-agent scenarios in a manner portable to any simulator. In Scenic, users can precisely model a stochastic environment in which an autonomous/semi-autonomous system operates, can perform a variety of design and analysis tasks, and can communicate them as interpretable programs. Scenic has a variety of demonstrated use cases, including synthetic data generation, data augmentation, debugging and retraining and redesign of perception components, sim-to-real validation, testing safety of autonomous system both in simulation and in the real world, training reinforcement learning agents in multiplayer settings, and more. To achieve these goals, Scenic has been designed to be (i) intuitive to learn, (ii) probabilistic to capture the uncertainty and stochasticity in the real world, (iii) simulator-agnostic, and (iv) open-source and in the public domain for external members to contribute.
Virtual Attendance:
In-Person Attendance:
8:00 am - 8:00 pm: Check in for parking permit, meal card, dorm room key (Central Conference Office)
6:15 pm - 7:00 pm: Dinner in College 9/JRL Dining Hall
8:00 am - 8:00 pm: Check in/out for parking permit, meal card, dorm room key (Central Conference Office)
7:45 am - 8:30 am: Breakfast in College 9/JRL Dining Hall
9:00 am - 9:30 pm: Opening and Introductions from Participants
9:30 am - 10:30 pm: Parallel sessions:
A (Main room): Hands-on tutorial on writing static scenarios (Colab Notebook)
B (Breakout room): Office hour with Scenic experts to discuss advanced topics or work on your own Scenic-related projects
10:30 pm - 11:00 pm: Coffee break
11:00 am - 12:00 pm: Parallel sessions:
A (Main room): Hands-on tutorial on writing dynamic scenarios (Colab Notebook)
B (Breakout room): Office hour with Scenic experts to discuss advanced topics or work on your own Scenic-related projects
12:00 pm - 12:30 pm: Scenic installation help
12:30 pm - 1:45 pm: Lunch in College 9/JRL Dining Hall
1:45 pm - 3:15 pm: Hands-on lab session (Exercises)
3:15 pm - 3:45 pm: Coffee Break
3:45 pm - 4:15 pm: Overview of Scenic's Python API, simulator interfaces, and other topics
4:15 pm - 5:15 pm: Hands-on lab session
5:15 pm - 6:15 pm: Free time / "Scenic" hike around campus
6:15 pm - 7:00 pm: Dinner at College 9/JRL Dining Hall
7:30 pm: Reception and "Crazy Ideas" Session (Namaste Lounge)
8:00 am - 1:00 pm: Check out (Central Conference Office)
7:45 am - 8:30 am: Breakfast in College 9/JRL Dining Hall
9:00 am - 9:30 am: Overview of Scenic case studies and applications
9:30 am - 10:30 am: Short talks by participants
10:30 am - 11:00 am: Coffee break
11:00 am - 11:30 am: More talks by participants
11:30 am - 12:30 pm: Working Group Meetings: Autonomous Driving (main room); Robotics and Other Domains (breakout room)
12:30 pm - 1:45 pm: Lunch
1:45 pm - 2:15 pm: Using VerifAI with Scenic; generating synthetic data; Scenic as part of a pipeline
2:15 pm - 3:15 pm: Hands-on lab session
3:15 pm - 3:45 pm: Coffee break
3:45 pm - 4:45 pm: General discussion
4:45 pm - 5:15 pm: Closing session and end of workshop (Feedback survey)
For details, please contact Daniel Fremont.
Website template by Oriane Siméoni from the
Object
localization
for free CVPR '23 tutorial.