- Nov 1, 2024
- 337
- 56
Been running OpenAI’s new Codex this week.
Not to be confused with Copilot. This isn’t “autocomplete plus.” This is a cloud agent that spins up a container, clones your repo, runs your tests, and sends back actual PRs — complete with diff links, commit messages, and context-aware bug fixes.
Tested it on a few legacy codebases and some automation side projects. It’s not perfect, but it gets scary close to "give it a ticket, walk away, come back to a PR."
Codex CLI is also open-source:
https://github.com/openai/codex#openai-codex-cli
Did the same with a scraping pipeline built in Playwright. Codex mapped the async flow, added try/catch blocks, and cleaned up some retry logic based on the error logs I pasted in.
Not to be confused with Copilot. This isn’t “autocomplete plus.” This is a cloud agent that spins up a container, clones your repo, runs your tests, and sends back actual PRs — complete with diff links, commit messages, and context-aware bug fixes.
Tested it on a few legacy codebases and some automation side projects. It’s not perfect, but it gets scary close to "give it a ticket, walk away, come back to a PR."
What It Actually Does (Tested):
- Refactors entire modules from a single prompt
- Diagnoses bugs from stack traces and logs
- Writes and attaches tests automatically
- Reads your README, ENV vars, and agent config to act accordingly
- Runs in an isolated container, doesn’t touch your repo until you approve changes
- Ask mode (Q&A + small tasks)
- Code mode (pulls the whole repo and starts operating)
Codex CLI is also open-source:
https://github.com/openai/codex#openai-codex-cli
Use Case I Tried
Fed it a messy TypeScript file with too much logic in one place. Asked it to modularize and add unit tests. It parsed the file, asked smart clarifications, and pushed back a structured PR with working tests and type coverage.Did the same with a scraping pipeline built in Playwright. Codex mapped the async flow, added try/catch blocks, and cleaned up some retry logic based on the error logs I pasted in.
Stuff It Handles Well (So Far):
- Refactors with architectural memory
- Fast, containerized debugging without touching prod
- Prompts like “convert to class-based” or “add error logging here” work well
- Will install packages, modify configs, and ask before doing anything destructive
- Doesn’t always get business logic right — needs guidance
- Can be over-confident with changes to monorepos
- Needs a bit of prompt engineering to handle legacy spaghetti
Real Questions for Devs Here
- Has anyone tried looping it into a CI/CD flow yet?
- Can this realistically be used for browser automation agents? Thinking Playwright bots that refactor themselves based on error logs
- If you're scraping or automating with proxies, could Codex be taught to manage IP rotation, captchas, etc?
- Anyone integrating this with LangChain agents or n8n workflows?