In ~10 minutes of asking for an outline first and then asking it to fill in functions it left unimplemented in the first replies, I got ChatGPT to provide the basics of a DNS server from scratch that I only had to correct about two lines of to be able to run and execute queries against.
This isn't a hard problem (it's a few dozen lines of code to do the bare minimum, maybe a couple of hundreds to add a reasonably full featured parser), but it involved a conversation of refining it that wasn't just "fill in this missing detail", but e.g. asking it to implement parsing of the query package in a specific language (Ruby), using a specific API, and using a specific format. Ruby ships with a DNS implementation; the ChatGPT solution looks nothing like either the standard Ruby implementation or the alternative Ruby DNS implementations I've checked.
You must know parrots with better reasoning skills than I do.
[EDIT: Note that I specifically picked this exactly because I was sceptical of how well it'd do, it's something I've done before myself, with a protocol I know well enough to be able to evaluate the code without much effort]
This isn't a hard problem (it's a few dozen lines of code to do the bare minimum, maybe a couple of hundreds to add a reasonably full featured parser), but it involved a conversation of refining it that wasn't just "fill in this missing detail", but e.g. asking it to implement parsing of the query package in a specific language (Ruby), using a specific API, and using a specific format. Ruby ships with a DNS implementation; the ChatGPT solution looks nothing like either the standard Ruby implementation or the alternative Ruby DNS implementations I've checked.
You must know parrots with better reasoning skills than I do.
[EDIT: Note that I specifically picked this exactly because I was sceptical of how well it'd do, it's something I've done before myself, with a protocol I know well enough to be able to evaluate the code without much effort]