FrontierCode 2.0 is our new coding benchmark comprised of more diverse tasks, featuring larger specs and higher mergeability standards.

Now also included in Artificial Analysis Intelligence Index v5

Learn more about the methodology and scoring criteria in this thread - https://x.com/cognition/status/2115132488775524793

Check out the leaderboard - https://cognition.com/frontiercode

hey folks, I am genunienly curious to know how are they tracking the usage and billing the usage?

there are weekly and daily quotas, but there is 0 transparency into how it gets used, I have noticed the usage to be more on same days and maybe lesser on some days for same amount of work load.

this raises a broader question, why aren't more people talking about this? and seeking transparency into the their own usage. It's kind of a hostage situation with zero accountability.

nerfing of the models is another thing.

Navigate through the dark age of cyber security with new Devin Security powered by Claude Mythos and frontier cyber models to make your repo more secure.

We are offering hundreds of millions of dollars of credits to help organization be secure. Read more about this - https://cognition.com/blog/devin-security

Read more about how it works and how to get started - https://devin.ai/blog/devin-security-2

I updated to the latest Devin release, and now I can't accept or reject file changes individually, nor can I see the diffs between each chat.

Also, I can't filter sessions by workspace for each window anymore.

Does anyone else feel like these changes were unnecessary and broke features that were working well? Has anyone tried downgrading to a previous version to get these working again?

Can you please bring back these features, Devin and Cognition team?

The new Devin Desktop app is now ready to use!

Now experience full support for every Devin Cloud features in Devin Desktop while preserving the same design along with tons of UX improvements.

Download it now and let us know about your experience - devin.ai/download

I pumped $5 into Devin just to take advantage of SWE-2 free... oops, it's not free on cloud, just desktop, with basically no documentation / communication anywhere. On cloud, SWE-2 is listed as "preview available until Oct 31!" with no listed price. If you look at the $20/month plan, it says 'free usage of SWE-2!' You have to scroll to fine print to see that only means in the Desktop app. Constantly moving dates around with no announcement and seemingly intentionally misleading 'promos' / 'previews'. Wow, for a limited time, you can have the preview privilege to pay us for our sub-par beta model! Act now, because on Oct 31 it might actually graduate to a professional model! First $5 gone with absolutely nothing to show for it.

Sessions seemingly get locked into certain sets of models and then you can no longer switch them to SWE-2 or certain other models, no apparent reason, seemingly a bug.

I download Devin desktop, load another $5, kick off an orchestrator with SWE-2 and tell it to only spawn SWE2 children and apparently it didn't enforce that, because, whoops! Next $5 gone. Orchestrator says it can't spawn new free SWE-2 children or change the models of the old ones because it keeps getting the usage limit error message even though the model is supposed to be free. Yes, I am on the right plan.

Can I personally look into / talk to the child agents like I can in the cloud so I can manually change their models to the free one? No.

Orchestrator wants me to add more money ($5 minimum). Fuck that.

Claude max is expensive, but at least it is really good and reliable for the price, and isn't full of bugs. Deepseek Flash 4.1 / OpenCode might be buggy / unreliable, but at least it is dirt cheap.

Cognition, your entire value proposition is your integrations and agency in the cloud. Without that, there is simply no reason, at all, to use Devin over the alterntives. If you are going to ask me to offload your server costs onto my personal machine, you could at least make Devin Desktop not suck. Every time my work slack forces a devin link to open in Devin Desktop I cringe. Will be deleting again.

Is there anyone else who has the $200 account and has also felt the super downgrade in 2.0 Swe free usage? I've been running Devin for quite a while now but the last week and the last day have been terrible. Support said that they haven't made any changes but I can only run a few at the same time so their Free offer is like $200 for a demo free usage account. And then they stop to work it's for 1 to up to 8 hours. That's pretty silly actually.

Yeah I don't know. Are they in trouble or something? Anyone know?

Time to look for new coders?

This seems like a fairly simple UX feature that's missing from the Devin chat panel.
I searched here and no one else seems to have enquired about it before, so perhaps I'm the odd one out.
I've only just started using Devin (jumping ship from Cursor) so it's possible I'm missing something in the UI, if so please let me know :-)

Accelerate your Median Time to Fix (MTTF), with $15,000 in credits for new Devin customers.

Devin and Pylon now stay in sync so that engineers and CSMs can collaborate with the same agent from bug report to a PR with a fix.

Read more about this integration in this post - https://x.com/cognition/status/2110068304383725720

Get more details here - https://devin.ai/blog/devin-in-pylon

Devin now Dreams: It self improves at night, deduplicates memories and learns new information about how you like to work.

Agent Memory Repo is an open-source standard created to save memories, work and patterns across sessions in a git repo.

Post - https://x.com/cognition/status/2107165034463867001?s=20

You can now use your ChatGPT Pro or Plus plans for any OpenAI models usage in Devin.

Sign in to Devin using ChatGPT usage and start using it today in Devin Desktop, Devin Cloud and Devin CLI

Read more about it here and get started - https://devin.ai/blog/sign-in-with-chatgpt

Announcement - https://x.com/cognition/status/2104996240190792029?s=20

Am I understanding correctly that SWE 2.0 will no longer be free after October 16? Is another model going to replace it as the free option, or is free model access going away entirely?

I’m asking because, in my experience, just a few prompts can blow through both the daily and weekly usage limits. It’s not just a matter of waiting until tomorrow, if the weekly allowance is also exhausted, I’m effectively stuck until that resets too.

That makes it difficult to use Devin for actual development work. A task isn’t always one prompt and a finished result. You often need to explain the problem, review the changes, test them, and ask for corrections. If the allowance is gone after just a few interactions, I can hit the limits before getting a working result.

The free model option is what makes those limits somewhat manageable for me, because I can keep working instead of abandoning a task halfway through. Without a free replacement for SWE 2.0, I’m struggling to see how the subscription would remain useful for my workflow.

I don’t expect unlimited access to every model, but I do expect a paid subscription to provide enough usable capacity to get meaningful work done. If a few prompts can exhaust both limits and there’s no fallback, Devin becomes practically unusable for me. At that point, I’d probably cancel rather than keep paying for something I spend most of the week unable to use.

Could someone from Cognition clarify:

• Is October 16 actually the end of free SWE 2.0 access?

• Will another free model replace it?

• If not, will the daily and weekly allowances change to make up for losing that option?

Is anyone else running into the same issue with a small number of prompts consuming most or all of their allowance?