Why AI Isn't Ready to Be a Real Coder (spectrum.ieee.org)
70 points by WolfOliver 3h ago 80 comments
Claude Sonnet will ship in Xcode (developer.apple.com)
462 points by zora_goron 17h ago 362 comments
Essential Coding Theory [pdf]
111 ibobev 21 8/29/2025, 3:53:41 PM cse.buffalo.edu ↗
This PhD thesis gives a very good introduction: https://arxiv.org/abs/2104.10544
It's published as a textbook but a version is also available online: https://people.lids.mit.edu/yp/homepage/data/itbook-export.p...
W.\ Wesley Peterson and E.\ J.\ Weldon, Jr., {\it Error-Correcting Codes, Second Edition,\/} The MIT Press, Cambridge, MA, 1972.\ \
and for the abstract algebra, e.g., field theory
Oscar Zariski and Pierre Samuel, {\it Commutative Algebra, Volume I,\/} Van Nostrand, Princeton, 1958.\ \
;-)
The problem with information theory is that it's very easy to get things mixed up hopelessly, unless you decide in advance what each term means. There are too many similar concepts with similar names.
A lot of modern coding does involve programming. But it is more concerned with storage and transmission of information. Like how to reduce the symbols (in info theory parlance) required for representing information (by eliminating information redundancy), how to increase the error recovery capability of a message (by adding some information redundancy), etc. Applications include transmission encoding/decoding dats (eg: DVB-S, Trellis code), error detection and correction (eg: CRC32, FEC), lossless compression (eg: RLE, LZW), lossy compression (most audio and video formats), etc.
As you may have already figured out, it's applications are in digital communication systems, file and wire formats for various types of data, data storage systems and filesystems, compression algorithms, as part of cryptographic protocols and data formats, various types of codecs, etc.