mstdn.io is one of the many independent Mastodon servers you can use to participate in the fediverse.

Administered by:

Server stats:

382
active users

Got Coder 33B running on my desktop's card with .

First off, I tested its ability to generate and understand code. Unfortunately, it falls into the same confusion of the smaller 6.7B model.

gist.github.com/codewiz/c6bd62

GistTesting DeepSeek Coder's knowledge of RustTesting DeepSeek Coder's knowledge of Rust. GitHub Gist: instantly share code, notes, and snippets.

To be completely fair, thread safety and atomics are advanced topics.

Several humans I have interviewed for engineering positions would also have a lot of trouble answering these questions. I couldn't write this code on a whiteboard without looking at the Rust library docs.

The main problem here is that the model is making up poor excuses to justify Arc<AtomicUsize>, showing poor reasoning skills.

Larger models like should do better with my questions (haven't tried yet).

@codewiz Damn, that is good. The way it offers the type annotated version of the example when you asked for the type of one variable is also really nice.

@penguin42 Check my last post on Codestral.

Hard to tell if it's better or worse than GPT-4o...

Bernie

...it typically takes twenty to thirty cross-referenced questions to detect a Nexus-60B model 😆

@penguin42

@codewiz Anything that can remember Rust macro syntax from memory must be a replicant....