Agentic Software Development

Overview

Coding agents have changed the economics of software development: producing plausible code is fairly cheap, while understanding, verifying, evolving, and operating software systems remains expensive. This course teaches software design for that world. Students learn to design systems that are easy to verify, change, reuse, scale, and operate. Students build and evolve one system across the whole semester through a series of connected assignments, supervising agents throughout.

After completing this course, students will:

See a more detailed list of learning goals describing what we want students to know or be able to do by the end of the semester.

Coordinates

M/W, 11:00 a.m. - 12:20 p.m., Tepper Building (TEP) 1403

Hammad Ahmad, TCS 341 (office), office hours: see calendar.

Claire Le Goues, TCS 363 (office), office hours: see calendar.

The instructors generally have an open door policy: if either of our office doors is open and no one else is meeting with us, we are happy to answer any questions. Feel free to also email us for appointments; we can meet with you in person or via Zoom. Our TAs also provide additional office hours each week; see details in the calendar.

Calendar

Schedule

The schedule below reflects our current plans, but is subject to change.

Date Topic
Mon, Aug 24 Course Introduction and Modern Software Engineering
Wed, Aug 26 Agentic Development and Design for Verification
Fri, Aug 28 Lab 1 Course Infrastructure and Your First Supervised Task
Mon, Aug 31 Testing and Testability
Wed, Sep 2 Test Design and Coverage
Fri, Sep 4 Lab 2 Testing, Testability, and Auditing a Generated Suite
Mon, Sep 7 No Class, Labor Day
Mon, Sep 7 Assignment 1 due Bad Slack
Wed, Sep 9 What Is a Software System's Design?
Fri, Sep 11 Lab 3 Find the Design Gap
Mon, Sep 14 Communicating and Recording Designs
Wed, Sep 16 Design for Change
Thu, Sep 17 Assignment 2 Checkpoint due Better Slack (v0.1)
Fri, Sep 18 Lab 4 Baby AWS Deploy
Mon, Sep 21 Assignment 2 due Better Slack (v0.1)
Mon, Sep 21 Modularity and Anti-Patterns
Wed, Sep 23 Midterm 1
Fri, Sep 25 Lab 5 Anti-Pattern Critique of Generated Code
Mon, Sep 28 Refactoring and Design Improvement
Wed, Sep 30 Design Patterns and Tradeoffs
Wed, Sep 30 Assignment 3 Checkpoint due Change and Reuse
Fri, Oct 2 Lab 6 API Contract Under Pressure
Mon, Oct 5 APIs, Libraries, and Frameworks
Wed, Oct 7 Assignment 3 due Change and Reuse
Wed, Oct 7 Evolution, Drift, and Engineering Memory
Fri, Oct 9 Lab 7 Direct a Refactor
Mon, Oct 12 No Class, Fall Break
Wed, Oct 14 No Class, Fall Break
Fri, Oct 16 No Lab, Fall Break
Mon, Oct 19 Agent Architectures
Mon, Oct 19 Assignment 4 Checkpoint due Refactor and Critique an Unfamiliar Codebase
Wed, Oct 21 Agent Supervision and Safety
Fri, Oct 23 Lab 8 Supervise a Repo-Scale Task
Mon, Oct 26 Software Architecture and Subsystem Design
Wed, Oct 28 Assignment 4 due Refactor and Critique an Unfamiliar Codebase
Wed, Oct 28 Data Models at Scale
Fri, Oct 30 Lab 9 Architecture Critique: Boundaries and Ownership
Mon, Nov 2 Concurrency and Asynchrony
Wed, Nov 4 Midterm 2
Fri, Nov 6 Lab 10 Find the Race
Fri, Nov 6 Assignment 5 Checkpoint due Scale What You Built
Mon, Nov 9 Coordinating and Communicating Systems
Wed, Nov 11 Containers and the Cloud
Fri, Nov 13 Lab 11 Events, Replay, and the Money
Mon, Nov 16 Assignment 5 due Scale What You Built
Mon, Nov 16 DevOps
Wed, Nov 18 Verification in the Pipeline
Fri, Nov 20 Lab 12 Stand Up a CI Gate
Mon, Nov 23 Supply Chain Security
Mon, Nov 23 Assignment 6 Checkpoint due Operate What You Built
Wed, Nov 25 No Class, Thanksgiving
Fri, Nov 27 No Lab, Thanksgiving
Mon, Nov 30 Observability and Monitoring
Wed, Dec 2 Summary and What We Learned Together
Fri, Dec 4 Assignment 6 due Operate What You Built
Fri, Dec 4 Lab 13 Make It Observable
Date TBD Final Exam (location TBD)

Staff

Instructors:

TAs:

Course syllabus and policies

Prerequisites


Grading and deadlines

Evaluation will be based on the following components:

This course does not have a fixed letter grade policy; i.e., the final letter grades will not be A=90-100%, B=80-90%, etc.

Homework grading and regrading. We try to be transparent in the rubrics in our assignments. Feel free to ask the instructors or TAs clarification questions about the rubrics before the assignment is due. If you disagree with a grade, please submit a regrade request within 7 days of grades being released on Gradescope. Regrade requests need a justification, explaining why our assessment is inconsistent with the rubric.

Labs. Labs are graded for completeness during recitations. You will show a TA the lab's three milestones and explain what happened and why. Your two lowest lab scores are dropped; there are no lab makeups. You can find more information about labs here.

Late work. We understand that normal life events, including projects and exams in other courses and technical difficulties out of your control, can interfere with your ability to complete your work on time or attend lectures and recitations. Our philosophy is that our late work policy includes built-in flexibility but that the policy will be uniformly applied to all students in all circumstances. Exceptions to this policy will be made only with explicit accommodations, almost always involving a family or medical emergency, with your academic advisor or the Dean of Student Affairs requesting the exception on your behalf.

We provide the following flexibility, no questions asked, no justification needed:

Any work submitted beyond the flexibility provided by these mechanisms will receive feedback but no credit unless explicit accommodations were provided.


Working with coding agents

You will use coding agents throughout this course; supervising them well is part of what we teach and grade.

You can find more details about the agent-use policy here.


Attendance and participation

This course, including recitations, is marked by the registrar as IPE ("delivered in-person, students are expected to be in the classroom during the course's scheduled meeting time"). We do not plan to make accommodations for remote attendance.

We strongly recommend attending lectures. We track your participation during the lecture (see the in-class quizzes above). Ask and answer questions! Attending recitations is required for grading labs, and is where your lab sign-offs happen.

Research shows that using devices on non-class-related activities harms both the device user's learning and other students'. Therefore, in general, we do not allow the use of devices during lecture. (Exception: you may briefly use a device for the in-class Canvas quizzes.) If you genuinely use your laptop for class-related activities (note-taking, etc.), tell us, and we will make an exception. However, we ask that if you do so, you be careful to keep your devices in note-taking mode (and don’t stray to Reddit, homework, doom-scrolling, etc.). In addition, you will be asked to sit in the back row of the classroom to minimize the impact your screen has on others.


Readings

The course may occasionally assign readings. You do not need to purchase any textbooks. Any assigned readings will be available for free and linked in the relevant lecture slides.


Time management

This is a 12-unit course, and we intend to manage it so that you spend close to 12 hours a week on the course, on average. In general, 4 hours/week will be spent in class, about an hour on labs, and the remainder on assignments. However, this is the first offering of this course, so our estimates could be off. Please feel free to give the course staff feedback on how much time the course is taking for you.


Research to improve the course

For this class, we are conducting research on teaching and learning. This research will involve some student work. You will not be asked to do anything above and beyond the normal learning activities and assignments that are part of this course. You are free not to participate in this research, and your participation will have no influence on your grade for this course or your academic career at CMU. If you do not wish to participate, please send an email to Chad Hershock (hershock@andrew.cmu.edu). Participants will not receive any compensation. The data collected as part of this research will include student grades. All analyses of data from participants’ coursework will be conducted after the course is over and final grades are submitted. The Eberly Center may provide support on this research project regarding data analysis and interpretation. The Eberly Center for Teaching Excellence & Educational Innovation is located on the CMU-Pittsburgh Campus and its mission is to support the professional development of all CMU instructors regarding teaching and learning. To minimize the risk of breach of confidentiality, the Eberly Center will never have access to data from this course containing your personal identifiers. All data will be analyzed in de-identified form and presented in the aggregate, without any personal identifiers. If you have questions pertaining to your rights as a research participant, or to report concerns to this study, please contact Chad Hershock (hershock@andrew.cmu.edu).


Collaboration policy and academic integrity

The usual policies apply, especially the University Policy on Academic Integrity. Assignments and labs are individual work. The key guiding principle: you may not copy any part of a solution that was written by another student or developed together with another student; you may not delegate your work to another person; and you may not look at or knowingly share solutions. Note that this implies you cannot publicly post your solutions on GitHub (e.g., as part of a portfolio during job applications). We also expect and respect honesty when communicating with the course staff.

Coding agents change what "your own work" means, so this course is explicit about it:

Any violation of this policy is cheating. The minimum penalty for cheating will be a zero grade for the whole assignment; incidents are also reported through University channels, with possible additional disciplinary action (see the University Policy on Academic Integrity). There is no statute of limitations for violations of the collaboration policy; penalties may be assessed (and incidents referred to the university disciplinary board) after you have completed the course, and some requirements of the collaboration policy (such as restrictions on you posting your solutions) extend beyond your completion of the course.

If you have any question about how this policy applies in a particular situation, ask the instructors for clarification.


Audit policy

If you desire to audit the course, our general requirement is that you complete homeworks assignments to achieve at least 50% of the total assignment grade. Solutions do not need to be fully complete, but we encourage you to attempt to do so. We additionally encourage you to attend lectures and complete labs, but you are not required to do so. You should not attend our midterm exams or final exam.


Your health matters

When we say "your health matters," we mean exactly that: Your health matters. We know that CMU can be a stressful, risky environment, and your health is the health that is relevant in this conversation.

Please take care of yourself. Do your best to maintain a healthy lifestyle this semester by eating well, exercising, avoiding drugs and alcohol, getting enough sleep, and taking some time to relax. This will help you achieve your goals and cope with stress.

All of us benefit from support during times of struggle. You are not alone. There are many helpful resources available on campus and an important part of the college experience is learning how to ask for help. Asking for support sooner rather than later is often helpful.

If you or anyone you know experiences any academic stress, difficult life events, or feelings like anxiety or depression, we strongly encourage you to seek support. Counseling and Psychological Services (CaPS) is here to help: call 412-268-2922 and visit their website at http://www.cmu.edu/counseling/. Consider reaching out to a friend, faculty or family member you trust for help getting connected to the support that can help.

If you are worried about affording food or feeling insecure about food, there are resources on campus that can help. Email the CMU Food Pantry Coordinator to schedule an appointment: cmu-pantry@andrew.cmu.edu.

Respect for diversity. It is our intent that students from all diverse backgrounds and perspectives be well served by this course, that students' learning needs be addressed both in and out of class, and that the diversity that students bring to this class be viewed as a resource, strength and benefit. It is our intent to present materials and activities that are respectful of diversity: gender, sexuality, disability, age, socioeconomic status, ethnicity, race, and culture. Your suggestions are encouraged and appreciated. Please let us know ways to improve the effectiveness of the course for you personally or for other students or student groups.

Accommodations for students with disabilities. If you have a disability and have an accommodations letter from the Disability Resources office, we encourage you to discuss your accommodations and needs with us as early in the semester as possible. We will work with you to ensure that accommodations are provided as appropriate. If you suspect that you may have a disability and would benefit from accommodations but are not yet registered with the Office of Disability Resources, we encourage you to contact them at access@andrew.cmu.edu.


Informal feedback on this course

This course is a substantial redesign and not everything will work out smoothly the first time. We would like you to provide ongoing feedback on your experience in the course, so that we can take into account your experience and adapt our practices to make the course work for you.

Outside of the regular course meetings and Piazza, you can submit feedback about anything in the course by email to the instructors or ask TAs to forward it anonymously. We will read every message submitted and use your feedback to try to improve the way we are teaching.