The Jack-PC (for wall jack, I presume). Runs on Windows CE. I guess you'd need a monitor, keyboard and mouse, but the CPU plugs in to the wall socket from which it gets power and ethernet. v.cool.

If you look closely, you'll see sound and USB ports. Check out the Windows for Devices article: “Thinnest thin client hides in wall-mount LAN box”