1<html><head><title>toybox news</title> 2<!--#include file="header.html" --> 3 4<p>Toybox combines the most common Linux command line utilities together 5into a single BSD-licensed executable that's simple, small, fast, 6reasonably standards-compliant, and powerful enough to turn Android into 7a development environment. See the links on the left for details.</p> 8 9<h2>News</h2> 10 11<a name="30-11-2021" /><a href="#30-11-2021"><hr><h2><b>November 30, 2021</b></h2></a> 12<blockquote><p> 13Busy? We'll I've just got this bulldozer to lie in front of or otherwise it'll 14knock my house down but otherwise no, not especially, why?</p> 15<p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 16 17<p><a href=downloads/toybox-0.8.6.tar.gz>Toybox 0.8.6</a> 18(<a href=https://github.com/landley/toybox/releases/tag/0.8.6>git commit</a>) 19is out, with prebuilt <a href=downloads/binaries/0.8.6>static binaries</a> and 20<a href=downloads/binaries/mkroot/0.8.6>mkroot images</a> 21bootable under QEMU (using vanilla linux-5.15).</p> 22 23<p><u>Make root</u>: The <a href=faq.html#mkroot>system builder</a> got upgraded, with better 24logging and layout of the output directory, plus <a href=https://github.com/landley/toybox/blob/0.8.6/scripts/mkroot.sh>scripts/mkroot.sh</a> 25should be easier to read and understand now. 26(Also added basic support for the <a href=http://lists.landley.net/pipermail/toybox-landley.net/2021-August/012497.html>qualcomm hexagon</a>, 27although it just builds a chroot filesystem, you can't boot a hexagon kernel under qemu 28<a href=https://lists.nongnu.org/archive/html/qemu-devel/2021-07/msg06430.html>quite yet</a>.)</p> 29</p> 30 31<p><u>New commands</u>: Rob added <b>linux32</b>. 32Dan Brown added <b>sha256sum</b> (and the related 224/384/512 variants). 33In pending, Elliott contributed <b>strace</b> and 34Moritz Röhrich contributed <b>hexdump</b>.</p> 35 36<p><u>Features</u>: 37Elliott added <b>date -s</b>, <b>pmap -p</b>, <b>tail -F -s</b>, <b>kill -0</b>, 38<b>reboot/halt/poweroff -d</b>, taught <b>file</b> to 39recognize Mach-o universal binaries, made Android's <b>log</b> 40take input from stdin when it has no arguments, added <b>tail --bytes --lines</b> 41(the --long synonyms for -c and -n), 42added <b>i2cdetect -q</b>, taught <b>i2cdump</b> to write XX for 43read failures, made <b>timeout</b> use the monotonic clock, 44and modernized the output of <b>uptime</b>.</p> 45 46<p>Rob added <b>find -quit -lname -ilname</b> and <b>-d</b> as a synonym for -depth, 47taught <b>cut -d $'\n'</b> 48to cut by line and added posix <b>cut -nb</b> (which wraps to the start of -c 49utf8 characters), added <b>cpio --ignore-devno --renumber-inodes</b>, 50taught <b>cal</b> to use 3 arguments (day month year), added <b>tar --selinux</b> 51support and a "had errors" message at the end, made <b>uname -o</b> 52say "Toybox", and fixed the <b>grep -Fw</b> combination (used by the 64 bit 53powerpc kernel build).</p> 54 55<p>Ella-0 added <b>split -n</b>. Peter Collingbourne added <b>grep -L</b>.</p> 56 57<p><u>Outside world</u>: The 0BSD license is <a href=https://lwn.net/Articles/868882/>now part</a> of the 58<a href=https://standards.iso.org/ittf/PubliclyAvailableStandards/>ISO-5962</a> 59standard. Of the currently <a href=https://github.com/search?q=license%3A0bsd&type=Repositories&ref=advsearch>38k 0BSD licensed projects on github</a> toybox 60isn't even the most popular, it's fourth.</p> 61 62<p>Elliott asked that toybox's <b>cut -DF</b> feature (a cheaper 63alternative to <b>awk '{print $3}'</b> be supported by other packages so 64it might someday make it into posix, so Rob 65<a href=http://lists.busybox.net/pipermail/busybox/2021-June/088886.html>submitted it to busybox</a> 66where it was <a href=https://git.busybox.net/busybox/commit/?id=0068ce2fa0e3>eventually merged</a>.</p> 67 68<p>Added a local <a href=https://landley.net/toybox/git>git mirror</a> for 69those reluctant to trust Microsoft Github.</p> 70 71<p>In the web nav bar, our <a href=https://isfreenodedeadyet.com/>freenode</a> 72channel moved to libera.chat 73(like <a href=https://boingboing.net/2021/05/19/freenode-irc-staff-quit-after-new-owner-seizes-control.html>everyone else's</a>; 74<a href=https://lwn.net/Articles/856543/>there</a> 75<a href=https://hackaday.com/2021/05/20/freenode-debacle-prompts-staff-exodus-new-network/>was</a> 76<a href=https://twitter.com/marcan42/status/1396280769778098185>a</a> 77<a href=https://twitter.com/mjg59/status/1396237336988446722>certain</a> 78<a href=https://www.devever.net/~hl/freenode_abuse>amount</a> 79<a href=https://twitter.com/TwitchiH/status/1395756163527028739>of</a> 80<a href=https://twitter.com/joepie91/status/1395364883303182339>drama</a> 81<a href=https://twitter.com/RichFelker/status/1404816846734385164>involved</a>).</p> 82 83<p><u>Pending</u>: lots more work on <b>toysh</b>: it has basic $((math)) support 84now, += assignment, the "declare" command and corresponding variable 85types (declare -i, declare -u, etc), several bugfixes, greatly 86improved support for background processes on NOMMU systems, and a bunch 87more sh.test entries.</p> 88 89<p>Elliott fixed <b>modprobe</b>'s parsing of short lines. Rob fixed a 90division by zero error when <b>vi</b> tries to edit a zero length file. 91Anqi Dong made sure that syslogd messages sent to sockets end with a 92newline. Eric Molitor significantly upgrade <b>wget</b> with http 1.1, 93chunked encoding, and (external library) https (TLS 1.2) support, 94plus several bugfixes. Michael Hope fixed <b>tftpd</b>'s option parsing.</p> 95 96<p><u>Documentation</u>: The roadmap.html and status.html pages 97got noticeable updates. (status.html is now directly generated by 98scripts/mkstatus.py, the old status.html wrapper that server-side-included 99status.gen has been removed). 100The <a href=design.html>design</a> 101page provides better links to the LP64 documentation, and the 102<a href=code.html>code</a> page explains a corner case where the filename 103and first command name expect to match (and how to work around it if they don't). 104Some website files weren't in the repository: two jpegs linked from html 105files, and the www/.htaccess file that triggers the server side includes 106in the navigation menu is now checked in. Johannes Schmitz fixed a 107typo in about.html.</p> 108 109<p>The <b>shred</b> usage line now includes all options. 110The <b>logwrapper</b> command now warns when it isn't built standalone. 111The <b>help</b> command no longer shows a header line about toybox unless 112it's called with no arguments. (It still shows it for command --help.) 113The --help option no longer needs to be the first option, and is 114checked before the "Not root" error message for restricted commands.</p> 115 116<p><u>Bugfixes</u>: 117Elliott made <b>ps</b> exit with status 1 if no processes were shown (for LTP), 118fixed an off-by-one in <b>dmesg</b> and a bounds check in <b>netstat</b>, 119fixed <b>pidof -s</b>, and taught <b>rmmod</b> to handle multiple arguments. 120Denys Vlasenko pointed out that <b>free -t</b> is "total" not "terabytes". 121Samanta Navarro pointed out a leftover 32 bit limitation in argument groups. 122Mikhail Kashkarov fixed mkdir's error handling for existing directories 123without -p. 124Rob fixed the 32 bit <b>readelf</b> build on Android, fixed a race condition 125in <b>tar</b> leading 126to the occasional spurious archiver warning, 127<a href=https://github.com/landley/toybox/commit/127cff38809e>changed cp</a> 128to work around a posix violation in the kernel, made xparsedate() handle more 129whitespace and ignore trailing + or - (a NOP timezone), made <b>su</b> log the 130right username, switched getuid() checks to geteuid() in <b>df</b> and <b>ping</b>, 131fixed a place in the test suite where do_test() 132could get confused by symlinks in the $PATH (calling realpath too early 133and losing the name of the command being run), 134made <b>env -i</b> use the old $PATH to run its command, 135and made <b>grep --color</b> highlight all matches.</p> 136 137<p>Worked around a bug in glibc+gcc 9.3 where linking against librt.a 138(for things like timer_create()) pulls in libgcc_eh.a which uses 139threads, meaning you can't statically link against librt.a from 140a non-threaded app. (I hadn't noticed because it works fine with the musl 141and llvm/bionic toolchains, only fails statically linking on e.g. debian.) 142The <a href=https://github.com/torvalds/linux/commit/d18760560593>kernel fix</a> for the cpio encrypted filesystem issue worked around in 0.8.5 made 143it in. Similarly, the 144FS_IOC_{GET,SET}{VERSION,FLAGS} ioctl family are <a href=https://www.spinics.net/lists/linux-api/msg49101.html>historically broken</a> 145(taking an unsigned int argument while advertising signed long), 146which <a href=https://github.com/landley/toybox/commit/dcfac5c983ad>we fixed</a> and reported upstream to a long 147round of bikeshedding (sadly 148the result seems to have been the man page maintainer 149<a href=https://git.kernel.org/pub/scm/docs/man-pages/man-pages.git/commit/man2?id=3de87d46840d>giving up</a> 150on documenting ioctls at all.</p> 151 152<p><u>Cleanups</u>: 153<b>cut</b> switched to FLAG() macros and no longer allows -f with -F, 154<b>eject</b> uses FLAG() macros and the linux/eject.h header, 155prettycool@protonmail added tabs to <b>time</b>'s output, and Rob removed 156the floating point dependency from time. Minor cleanups 157to lsattr, lspci, nsenter, xxd, file, insmod, modprobe, arp, bootchartd, pmap, 158comm, lsof, blkid, crond, init, userdel, makedevs, and scripts/make.sh. 159The "int fd = fd;" 160initialization hack to shut up gcc's "may be used uninitalized, but isn't" false 161positive warning has been replaced by a QUIET macro that resolves 162to nothing on llvm (which doesn't have the gcc bug). 163Ryan Pritchard reported a bug where <b>alias ls="ls --color"</b> would prevent 164--help or --version from being the first argument to the command, which was 165a pain to fix without breaking things like <b>echo -- --version</b> and 166<b>basename -s --help file--help</b>. 167(Both toy_singleinit() in main.c _and_ get_optflags() in lib/args.c now 168check for those.)</p> 169 170<p><u>Infrastructure</u>: 171xabspath() now has a more granular (flag based) control interface.</p> 172 173<p><b>scripts/make.sh</b> now uses wait -n (available since bash 4.3 in February 2014) 174to keep the processors busier during a parallel build. 175Tests are now running in a subshell, which means functions and local 176variables defined in one don't pollute others during "make tests". 177 178<p>Guo Chuang reported that lsattr won't build on an 8 year old version of 179<a href=https://github.com/landley/toybox/pull/292#issuecomment-899895909>centos</a>, 180which is still supported for 2 more years because Red Hat can 181be paid to have a 10 year support horizon, longer than toybox's 7. Rob 182fixed it (and merged a similarly ancient compilation failure fix when 183building pending/ip.c against a 3.10 kernel), 184but the <a href=http://lists.landley.net/pipermail/toybox-landley.net/2021-August/012537.html>philosophal argument</a> 185remains <a href=http://lists.landley.net/pipermail/toybox-landley.net/2021-September/012603.html>unresolved</a>.</p> 186 187<p>Standalone builds can now override the .config file location with 188KCONFIG_CONFIG same as the multiplexer build. scripts/single.sh can 189now cope with a missing .config file (it uses the defconfig values 190for the CONFIG_TOYBOX_* global symbols). 191"make install_airlock" no longer needs host versions of sha256sum and sha512sum.</p> 192 193<p>In the test suite, <b>VERBOSE=spam</b> now shows expands successful tests 194like it would for errors.</p> 195 196<p><b>scripts/record-commands</b> got updated and logwrapper got renamed <b>logpath</b>.</p> 197 198<a name="19-05-2021" /><a href="#19-05-2021"><hr><h2><b>May 19, 2021</b></h2></a> 199<blockquote><p>It was of course a descendant of these eccentric poets 200who invented the spurious tales of impending doom which enabled the people of 201Golgafrincham to rid themselves of the useless third of their population. 202The other two-thirds stayed firmly at home and lived full, rich and happy lives 203until they were all suddenly wiped out by a virulent disease contracted from 204a dirty telephone.</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 205 206<p><a href=downloads/toybox-0.8.5.tar.gz>Toybox 0.8.5</a> 207(<a href=https://github.com/landley/toybox/releases/tag/0.8.5>git commit</a>) 208is out, with prebuilt <a href=downloads/binaries/0.8.5>static binaries</a> and 209<a href=downloads/binaries/mkroot/0.8.5>mkroot images</a> 210bootable under QEMU (using vanilla linux-5.12, except that s390 needed another 211<a href=http://lkml.iu.edu/hypermail/linux/kernel/2105.2/02904.html>perl 212removal patch</a>).</p> 213 214<p>This development cycle had thirty commits to sh.c fixing bugs and adding 215features to <b>toysh</b>. Shell functions and local variables are now implemented, 216along with the "set" builtin and trace support, and job control is 217about halfway in. The shell as a whole is <a href=https://en.wikipedia.org/wiki/Ninety%E2%80%93ninety_rule>maybe 80% done</a>, but still 218has some obvious gaps like $((math)) and interactive command line 219history/editing, plus a bunch of testing.</p> 220 221<p><u>New commands</u>: 222Moritz Röhrich added <b>pwgen</b> and <b>base32</b>, and 223Elliott Hughes added <b>unicode</b>. The 224<b>readelf</b> command got promoted out of pending, and 225<b>sha3sum</b> is now switched on in defconfig.</p> 226 227<p>Michael Christensen added <b>chsh</b> to pending, which hasn't been promoted 228yet because it's part of a group of commands (useradd, userdel, groupadd, 229groupdel) that should all be promoted together at some point 230(and depend on lib/passwd.c, which could use some more work).</p> 231 232<p><u>Upgrades</u>: 233<b>cpio</b> now supports extracting multiple concatenated archives. 234<b>file</b> now recognizes android's new XML binary format. 235<b>devmem</b> now works on nommu, can handle 0x prefxes on the address, 236and prints 237hex or decimal output to match the address type. 238<b>df</b> -a now shows overmounted filesystems. 239<b>test</b> -k checks the sticky bit. 240Added -t to <b>install</b>, <b>cp</b>, and <b>mv</b>, and -u to <b>cp</b> 241and <b>cpio</b>. 242<b>find</b> -executable checks that _we_ can execute them (u+x could be owned 243by a different user or have selinux weirdness).</p> 244 245<p>Elliott added several features to <b>date</b> (--iso, %:z output format, and 246--utc as a synonym for -u), added a <b>sed</b> s///x option, 247added units to <b>ulimit</b> output, and 248made several UI changes to <b>hexedit</b> including a color 249mode (which is now the default, press x to toggle between old and new 250display), masked out the file type in <b>chmod</b> error messages and 251taught it to handle complex modes (like u+s+s), 252hardened <b>file</b> and <b>readelf</b> against invalid input, 253added a portability.h workaround for macos statvfs for <b>df</b>, 254enabled line buffering in <b>echo</b> and <b>yes</b>, 255and significatly sped up <b>tr</b>. Rob similarly optimized <b>seq</b> 256and <b>count</b>.</p> 257 258<p><b>make tests</b> now defaults to VERBOSE=fail (and now has VERBOSE=all to 259continue after failure, and VERBOSE=quiet to show FAIL: lines without 260diff -u output). 261Cleanups to tee, netstat, file, and df. Added "static" annotations in a 262lot of commands, made more things use FLAG() macros. Ethan Sommer pointed out 263an unnecessary wrapper function in chgrp. 264In pending, Elliott did some cleanups and bugfixes to gettty, telnet, telnetd, 265tftpd, init, modprobe, and dd, and added more features to vi. 266Rob did some cleanup on modprobe.</p> 267 268<p><u>Bugfixes</u>: 269Yi-Yo Chiang fixed a <b>rm</b> bug where -f could get confused by read 270only filesystems and produce an error trying to unlink a nonexistent 271file, pointed out <b>install</b> -D was broken when the target file 272already exists, pointed out a <b>cpio</b> interaction with certain encrypted 273filesystems where readlink() wouldn't write as much payload as the header 274promised (corrupting the archive) and fixed another cpio bug where -t test 275mode would chown() files, and fixed quoting in mount.test. 276Elliott fixed a sequencing issue in <b>setsid</b>'s system calls, 277fixed some <b>sed</b> tests (sed's lie-to-autoconf --version 278output was preventing toyonly tests from triggering) and 279fixed <b>tar</b>'s base 256 output for very large files. 280Nir Lichtman pointed out that <b>rm</b> -p shouldn't try to rmdir / at the end, 281Luke Frankart pointed out a typo that broke <b>test</b> checking file modes, 282Firas Khalil Khana fixed a duplicate entry in the roadmap, 283Ethan Sommer fixed <b>install</b> -Dt, 284Andy Hu requested that <b>mount</b> handle mixed options like 285-tnomsdos,smbfs. 286Denys Nykula reported a <b>chmod</b> regression, 287asm89 pointed out a <b>netcat</b> bug writing transactions larger than 2884k, 289Daniel Santana fixed <b>df</b> combining -P and -k, 290Robin Hsu fixed <b>grep</b> getting confused by libc setting errno when 291a library function call succeeded. 292Puck Meerburg taught the <b>gunzip</b> code not to be confused by FEXTRA entries 293(as described in RFC 1952) and added a test suite entry for that.</p> 294 295<p><b>find</b> handles empty arguments properly now (with test), <b>date</b> 296-I with no arguments no longer segfaults, <b>grep</b> -f /dev/null no 297longer adds a "" regex matching everything, -z no longer splits patterns 298on \n, and -o can print zero length matches, 299<b>cp</b> -t works with one argument and with --parents. 300<b>readelf</b> displays properly in 80 columns and doesn't reject .bss 301off end of file, and <b>sed</b> s///2 now works when there isn't more than one 302match. 303<b>tar</b> now removes empty directories where it wants to put a non-directory. 304<b>microcom</b> sets serial device terminal attributes correctly.</p> 305 306<p>The prebuilt x86-64 binaries shouldn't segfault on older x86-64 processors 307anymore (workaround for gcc bug). 308Cross compiling was sometimes confusing install.sh because it created 309a hyphenated "toybox-$TARGET" and then tried to make symlinks to just "toybox".</p> 310 311<p><u>Build</u>: 312CONFIG_TOYBOX_I18N went away: toybox builds always support utf8 now. 313Ella-0 added OpenBSD support (but not a separate defconfig, try 314"make freebsd_defconfig").</p> 315 316<p><u>Library</u>: 317utf8towc() is now unsigned instead of wchar_t, matching wctoutf8(). 318xclose() tests if fd is -1 so the caller doesn't have to. 319txpect (the test suite's built-in "expect", implemented in shell) can 320now do regex matches, and sh.test uses this.</p> 321 322<p>Elliott added the failing regex to the xregcomp() error message, and 323made multiple portability tweaks (header tweaks to build in more 324environments, running tests on Raspberry Pi OS and under mksh, 325fix utf8 locale selection on macos).</p> 326 327<p><u>Docs</u>: 328<b>chmod</b>'s help text explains why o+s doesn't set +t (and has a 329test for it). The <b>echo</b> help text is more compact. 330Checked in a better conversion of <a href=https://landley.net/toybox/toycans.png>toycans.png</a>.</p> 331 332<a name="24-10-2020" /><a href="#24-10-2020"><hr><h2><b>October 24, 2020</b></h2></a> 333<blockquote><p> 334"We are now cruising at a level of two to the power of twenty-five thousand to 335one against and falling, and we will be restoring normality just as soon as we 336are sure what is normal anyway."</p> 337<p>- The Hitchhiker's Guide to the Galaxy</p> 338</blockquote> 339 340<p>After a longer and slightly more 341<a href=https://github.com/landley/toybox/commit/07a896862ddf>turbulent</a> 342development cycle than some, 343<a href=downloads/toybox-0.8.4.tar.gz>Toybox 0.8.4</a> 344(<a href=https://github.com/landley/toybox/releases/tag/0.8.4>git commit</a>) 345is out with new commands <b>sha3sum</b> and <b><a href=https://github.com/landley/toybox/commit/6b4c32ae3986>watchdog</a></b>.</p> 346 347<p>There are <a href=downloads/binaries/mkroot/0.8.4>prebuilt mkroot binaries</a> 348now, tiny toybox linux systems for a dozen architectures, all bootable under 349qemu. (The vmlinux in each tarball is a vanilla linux-5.9 kernel built 350from the included config file.)</p> 351 352<p>The FAQ got <a href=faq.html>noticeably larger</a>, and the README has 353more links. New command features include the <b>sed -s</b> flag, 354<b>cpio --no-preserve-owner</b> now affects archive creation, 355Elliott added <b>tar -I</b> and multi-type 356<b>find -type a,b,c</b> support, Mark Salyzyn added <b>xargs -P</b> to 357run parallel jobs, the <b>ps</b> and <b>top</b> commands 358now autodetect pid length, and <b>top</b> adjusts units for memory display based on 359system size.</p> 360 361<p><u>Toysh and toyroot</u>: 362lots of new work on <b>toysh</b>: 29 commits to sh.c since last release, adding 1500 363lines and deleting 700, plus a bunch of sh.tests entries). Since last release 364we implemented wildcards, case/esac and select, brace expansion sequences 365(ala {1..10..2} and {a..z}), 366the remaining variable slice types ${a#y} ${a%y} ${a^y} ${a,y} 367${a/search/replace}, the "<b>source</b>" shell builtin, 368the start of job control, and several bugfixes. 369Plus the standalone "<b>make sh</b>" build understands MAYFORK now. It's 370still missing features like functions() and $((math)) but it's getting 371close to usable now.</p> 372 373<p><u>Documentation</u>: 374Some of the README contents moved to the FAQ, and the README's "presentations" 375section got some new links. Several new <a href=faq.html>FAQ</a> entries explaining things like 376mkroot ("how do I build a working Linux system 377with toybox"), cross compiling (how to get/setup the 2 compilers and 3783 libc we regression test against), and "where does toybox fit into the 379linux/android ecosystem". 380The "toybox --help" output now lists the project's web page (<a href=https://github.com/landley/toybox/issues/50>by request</a>). 381Elliott removed 382getevent (an android board bringup/hardware debugging tool built by running 383a python script against kernel headers, not really in scope for toybox), 384fixed xargs help formatting, and taught the toybox multiplexer's 385command list output (and "kill -l") to measure the current the terminal width 386when wordwrapping (previously hardwired to 80 columns). 387If you're curious, I checked in my <a href=www/release.txt>release procedure 388checklist</a>, and 389fixed a stale link in the nav bar on the left ("statistics" changed domains). 390Firas Khaliki Khana fixed some issues in the roadmap, and Rob 391tweaked the roadmap so status.html is slightly more current.</p> 392 393<p><u>Tests</u>: 394The "make tests" target now fails if any of the tests it ran failed. 395Lots of TEST_HOST tests got fixed (checking for specific error messages exposes 396TEST_HOST to version skew, and scripts/test.sh will now skip TEST_HOST 397commands that aren't installed) and added toyonly annotations as necessary 398(replacing most uses of SKIP_HOST). 399Eric Molitor added automated github tests on MacOS and Ubuntu using their 400"workflows" thing. 401The clang asan plumbing slows some code down more than 10 times, so some testing timeouts were expanded. 402 403<p><u>Pending</u>: 404Eric Molitor did a bunch of work on route: moved it to sbin, added xsend and 405xrecv, taught display_routes() and setroute to use the rtnetlink API and 406do hostname lookups, added support for mss, win, and irtt, merged ipv6 and ipv4 407codepaths with autodetection of address type, implemented RTA_CACHEINFO 408support, switched exit paths to perror_exit(), and removed unused code. 409Ethan Sommer fixed warnings in dhcpd, removed a bunch of unnecessary 410; after GLOBALS() blocks and an unnecessary return in df. 411Erik Moqvist fixed dns setting in the dhcp client. 412Rob did some cleanup on bootchartd, traceroute, getty... 413Elliott fixed getty to reliably update utmp. 414Chris Sarra added ipv6 support to wget. 415Ariadne Conill submitted several small fixes from testing Alpine Linux with 416toybox, and Antoni Villalonga i Noceras fixed typos in error messages.</p> 417 418<p><u>Bugfixes</u>: 419Elliott avoided sign extension in devmem, and Ethan Sommer switched it from 420getpagesize() to posix sysconf(_SC_PAGESIZE). 421Elliott fixed chmod -R 422ignoring dangling symlinks, fixed stty <a href=https://github.com/landley/toybox/issues/251>misparsing c_iflags</a>, fixed the chattr f2fs test with 423compression enabled, taught blkid not to show empty tags, taught xparsedate() 424to read date's default output format, fixed a recent echo -e \0 regression, 425changed cpio -p parsing to match a <a href=http://lists.landley.net/pipermail/toybox-landley.net/2020-August/011955.html>bug</a> in the gnu version 426which an existing script <a href=https://github.com/landley/toybox/commit/fa1af3b085cc>depended on</a>, 427and switched hwclock back to looking 428only at /dev/rtc0 for <a href=https://github.com/landley/toybox/commit/70e2232ce61c>reasons</a> involving kernel version skew and vendor bug reports.</p> 429 430<p>David Legault pointed out that unescape2() (and thus echo -e) wasn't handling 431\0 right. 432Khem Raj reported that mips glibc doesn't have SIGSTKFLT, leading to 433a build break if we assume glibc behaves consistently, which led to a bunch of 434macos signal portability cleanups from Elliott. 435William Djupström fixed tar extracting long file paths, adding hardlinks 436to an archive, and reported that --exclude wasn't working. 437Peter McConalogue pointed out that cp/mv -i prompt should 438default N, and mv should only prompt when stdin is a tty. 439Patrick Oppenlander made rtcwake and hwclock default to UTC if /dev/adjtime 440isn't available, suggested watchdog catch SIGINT, and caught an 441uninitialized offset in blkdiscard which gcc apparently didn't. 442Ryan Pritchard reported that <b>file</b> wasn't getting gif heights right, 443and Elliott added gif version output so TEST_HOST provided similar output. 444Martin Stjernholm fixed <b>cp -P</b> to not follow symlinks and updated 445the help text to say it's not the default. 446Antoni Villalonga added more --long asiases to <b>chgrp/chown/rmdir</b>. 447 448<p>The symlink indirection code subtly broke xexec() so it would still try to call 449a builtin when given a path to a command (fixed now). 450The code to trip \n off xgetline() was using the length of the allocation 451instead of the length of the read. 452Netcat no longer leaks sockfd into child processes. 453Patch "fuzz" support was outputting context lines from the hunk, not the 454file. Chrisrfq fixed i2cdetect parameter reading. 455Chris Sarra taught dd not to throw an error trying to truncate device files, 456added a misshing fflush() to lib/password.c, fixed a parse error in logger 457preventing local facility logging from working right, taught init 458to reload inittab when it receives SIGHUP, and fixed a memory leak in tar.</p> 459 460<p><u>Library</u>: 461New xvdaemon() function daemonizing on nommu systems, to wean commands 462off daemon() which requires TOYBOX_FORK. 463Teach sendfile_len() to use copy_file_range() when available, with compile 464time probe. Fix xsignal_all_killers() to install the correct handler. 465Rob switched dirtree_path() to a non-recursive implementation, and 466taught dirtree that a top level entry named "" is equivalent to 467"." but should not show up in dirtree_path(), 468read_password() now reads from tty device rather than stdin, and handles ctrl-c and ctrl-d, and 469human_readable() now has HR_NODOT so it can print single digit numbers without going "0.0". 470Petri Gynther increased the vmstat column sizes so it didn't fit 471in 80 columns anymore. 472Elliott added UTC offset support to xparsedate().</p> 473 474<p><u>Infrastructure</u>: 475mkroot now only passes --no-preserve-owner to cpio (so initramfs files 476belong to root rather than whichever user ran the build) when using toybox's 477version, because the other one is brain-damaged and errors out not 478understanding it. (It understands it for extract, but not create. Yes really.) 479New PENDING variable you can set to enable more than just sh and route out 480of pending. 481The "make distclean" no longer deletes root_download (where mkroot's "extra plumbing" 482file saves source code downloads it tarballs, such as dropbear).</p> 483 484<p><u>Cleanup</u>: 485Cleanup openvt (35 lines added, 78 lines removed) 486Cleanup blkdiscard so lib/args.c parses the -o and -l numbers, which means 48732 bit systems are limited to 2 gigabyte sizes which is a TODO item systemwide. 488oneit now uses flag macros and mentions -rn in the help. demo-utf8towc 489now has main.c call setlocale for it. 490Some cleanup on stty.</p> 491 492<a name="11-05-2020" /><a href="#11-05-2020"><hr><h2><b>May 11, 2020</b></h2></a> 493<blockquote> 494<p>Ford: Ah. A 495<a href=https://www.youtube.com/watch?v=WSsR419HBpQ>towel</a>. 496Keep this and guard it with your life.</p> 497<p>Arthur: Huh?</p> 498<p>Ford: Listen, it's a tough universe. There's all sorts of people and things 499trying to do you, kill you, rip you off, everything. If you're going to 500survive out there, you've really got to know where your 501<a href=towel.jpg>towel</a> is.</p> 502<p>- The Hitchhiker's Guide to the Galaxy</p> 503</blockquote> 504 505<p>Despite everything <a href=downloads/toybox-0.8.3.tar.gz>Toybox 0.8.3</a> 506(<a href=https://github.com/landley/toybox/releases/tag/0.8.3>git commit</a>) 507is finally out, with new commands <b>rtcwake</b> from Elliott Hughes and 508<b>blkdiscard</b> from Patrick Oppenlander. 509The big news is "<b>make root</b>" now boots to a shell prompt, 510with toysh making it all the way through toyroot's init script. 511(Some people were looking forward to <b>patch --fuzz</b> support too.)</p> 512 513<p><u>Toyroot</u>: <b>make root</b> now does what it says on the tin, it 514builds a bootable toybox-based Linux system using two source 515packages (toybox and linux). The trivial version is "make root && sudo chroot 516root/host/fs /init". Here's 517a <a href=http://lists.landley.net/pipermail/toybox-landley.net/2020-April/011667.html>post with instructions</a> if you want to know how to build the 518cross compilers for testing the various architectures. The self-contained 519<a href=https://github.com/landley/toybox/blob/0.8.3/scripts/mkroot.sh>script 520that builds a simple bootable Linux system</a> is 250 lines long, and 521should be easy to read if you want to know how it works.</p> 522 523<p>It also has basic module support, meaning arguments that aren't X=Y variable 524assignments are the names of scripts to run to build more 525packages at the end of the build. I checked in an <a href=https://github.com/landley/toybox/blob/master/scripts/root/dropbear>example package</a>, 526and there's generic "download and extract source tarballs" 527<a href=https://github.com/landley/toybox/blob/master/scripts/root/plumbing>plumbing</a> available to such modules. 528(The Makefile doesn't know how to pass module names through to the script, 529so instead of "make root" you have to 530call the script directly, ala "scripts/mkroot.sh CROSS=sh4 LINUX=~/linux dropbear".)</p> 531 532<p>The resulting root filesystem now uses /root as the home 533dir for UID 0, and creates /dev/fd and /dev/shm in devtmpfs. The build works 534around a kernel 535build bug where "make distclean" doesn't work in a "cp -sfR" symlink 536directory. (The bug meant if you pointed LINUX= at unclean source, it was 537unhappy, so now it distcleans the source directory before copying it. This 538modifies said source directory, which is not ideal, but as usual the kernel guys 539<a href=http://lkml.iu.edu/hypermail/linux/kernel/2002.2/00083.html>ignored 540the bug report</a>, so a workaround was required.) 541The CROSS=all build announces each target in the title bar, puts 542its logs into root/log, and has better trap handling to stop with one 543ctrl-c. 544Since last release it uses a more concise config format for the various kernel 545arch targets (which shrank the script by about 50%), and merged 546the old (now removed) scripts/cross.sh into the main script so 547"make CROSS=armv7l LINUX=~/linux" is 548literally just a call to "scripts/mkroot.sh CROSS=armv7l LINUX=~/linux" now.</p> 549 550<p>As for <b>scripts/mcm-buildall.sh</b> building cross compilers, 551of COURSE gcc 8.3 requires a different configuration to build the same 552toolchain as previous versions, it's gcc. It now builds a proper 553nommu libc for sh2eb without a broken fork() call in it that can never 554be used but prevents compile-time probes from detecting nommu, 555and checks that the cross compiler completed before trying to build 556the native compiler.</p> 557 558<p>This was all tested with a recent 559<a href=https://github.com/richfelker/musl-cross-make/commit/5086175f2902>version</a> 560of musl-cross-make with the top level Makefile 561edited to use BINUTILS_VER = 2.32 because the newer one 562<a href=https://www.spinics.net/lists/linux-sh/msg56844.html>breaks the kernel 563build</a> 564and LINUX_VER = 4.19.90 because the default musl-cross-make config uses an 565out-of-tree headers package for some reason (those who forget history are 566<a href=https://lkml.org/lkml/2006/4/28/194>doomed to repeat it</a>) which 567breaks m68k and s390x. I won't post binaries of the resulting toolchains 568because they're GPLv3, but <a href=https://musl.cc/>Thalheim might</a>. 569(I've also <a href=http://lists.landley.net/pipermail/toybox-landley.net/2020-May/011673.html>test built</a> 570with the Android NDK, but bionic's startup code currently segfaults before 571calling main() if it can't open /dev/null, and the kernel guys 572<a href=https://lkml.org/lkml/2017/9/13/651>ignored my patches</a> to 573make CONFIG_DEVTMPFS_MOUNT work in initramfs.)</p> 574 575<p>At the moment toyroot cheats and uses two commands out of pending: toysh 576is about 80% of the way to being useful but still missing some 577obvious features like function support, job and terminal control, command 578history, $((math)), wildcard expansion... plus a lot of bash features like array 579variables, so it isn't out of pending yet. And route needs to be redone to use the 580netlink interface that can handle multiple routing tables. For the moment 581scripts/mkroot.sh adds both of them to defconfig if you haven't already 582got a .config when you run it. (If you build and can't boot, your .config 583probably hasn't got CONFIG_SH switched on. Fix it in menuconfig, or 584rm .config and try gain.)</p> 585 586<p><u>New toybox features</u>: 587Elliott taught <b>patch</b> to understand [FILE [PATCH]] arguments, made 588<b>cal</b> highlight the current day, added -T to <b>cp</b>/<b>mv</b>, 589did a lot of work on <b>lsattr</b>/<b>chattr</b> (including adding -p 590and "chattr ="), added tar --absolute-names, taught <b>id</b> to 591support numeric lookup and handle unknown groups, made -G show all 592groups, and removed context= from -Z. 593Rob added <b>patch -F</b> (fuzz factor) support and <b>help -u</b> (usage only), 594taught <b>echo -e</b> about bash extensions like \uXXXX unicode escapes, 595<b>netcat -L</b> no longer automatically includes stderr (new -E 596option does that), 597<b>setsid</b> now uses -c (like the man page says) instead of -t, and added 598-w (wait) and -d (detach from tty). 599Andrew Ilijic added <b>ls -w</b>, removed trailing whitespace on output, 600and added tests for -C and -x.</p> 601 602<p><u>Library</u>: 603another fix to 32 bit option parsing of long long optflag values, 604remove getdirname() and just use the libc function (which modifies 605its argument, but we don't have to free a malloc), 606dlist_terminate() can now be called repeatedly on the same list, 607new relative_path() function finds path from one directory to another, 608and readfd() works like readfile() but on an already open fd. 609Use MPATH macros in mkpathat(). Elliott added macOS versions of 610dev_minor()/dev_major()/makedev() to portability.c, 611implemented posix_fallocate() for macOS, removed a 612leftover uClibc workaround in fallocate that was breaking macOS, 613and moved the table of ELF architectures from file to lib/lib.c (so 614readelf can share). 615Park Ju Hyung pointed out the fast path of fdlength() was commented out, 616and we switched it to the 64 bit API while we were there (and then Elliott 617added macOS support). 618Joeky taught file to recognize 7z archives.</p> 619 620<p><u>Pending</u>: 621The shell got a bunch of work: standalone "make sh" now includes the 622multiplexer for builtin commands like "exit" and "cd". Added MAYFORK annotation 623for commands that exist in the $PATH but can also be run within the shell 624process (and sometimes have different behavior within the shell): 625currently applied to help, echo, false, kill, printf, pwd, test, time, and 626true.</p> 627 628<p>Elliott added new commands <b>getopt</b> and <b>readelf</b>. 629Jarno Mäkipää taught wget how to follow http 301 and 302 redirects, 630and did lots of work on vi. (Elliott also did work on vi.) 631Gavin Howard fixed a comparison bug in bc. 632Ethan Sommer fixed numerous small issues (including several build 633warnings and FLAG() macro conversions).</p> 634 635<p><u>Bugfixes</u>: 636<b>tar</b> extract now deletes files and symlinks where it's making a directory, 637<b>find -L -type -l</b> now finds dangling symlinks, extra #ifdefs in 638portability.h prevent old gcc versions from barfing on __has_include(), 639xgetline() now returns NULL at EOF, tee with no arguments was 640writing to stdout twice, setsid works on nommu (I.E. vfork) now, 641<b>netcat -L</b> no longer accumulates zombie processes, 642<b>sntp</b> now uses adjtimex instead of adjtime (to build on bionic). 643xcreate_stdio() was checking WARN_ONLY in the wrong field (and tar was 644passing it in the wrong field, so it worked there). 645Several people wrestled with the <b>xargs</b> "argument too long" problem. 646Alessio Balsini fixed memory leaks in loopback_setup() and "wayling" 647added a missing continue to losetup. 648Elliott fixed xargs -E, various things in modinfo, 649added an error check to gzip when using zlib (which copies non-gzip data to 650the output verbatim for some reason), 651found an case where dirtree could use 652uninitialized data and silenced "Invalid argument" warnings (triggered by 653Android's selinux policies making stat() and readlink() fail), 654fixed locale support in macOS (both in iconv 655and in main.c), taught stat to show filesystem time on macOS, 656fixed a 32 bit truncation in sntp, fixed a memory access one byte outside 657of its array in patch.c, removed the cpio --trailer option, 658and widened the pid display fields in ps to 6596 digits. Rich Felker fixed find.c assuming 660time_t is a long (y2038 issue on 32 bit). 661Greg Kaiser fixed a thinko in get_block_device_size(). 662Jarno Mäkipää fixed utf8 support in cut -C, and cp --parents. 663David Legault complained that dir/.* tells rm to delete dir/.. and we'd do it. 664JakeSFR pointed out a bug in file's identification of broken symlinks. 665William Haddon fixed cp to treat a directory with a trailing slash 666teh same as one without. 667Denys Nykula fixed rm -i not to prompt for an empty "" argument. 668SebiderSushi reported that chmod g+s wasn't working. 669The linux kernel doesn't let an O_PATH fd work with fgetxattr(), so 670Elliott switched <b>ls</b> to use the path-based functions now (which is racy, 671it means you can stat() one inode and get the xattrs for a different one, 672but nobody in kernel land seems to use xattrs much so they're not fully 673supported by the API, and who's crazy enough to use xattrs for security 674anyway). Derick Pallas pointed out an xclearenv() bug. 675Atatsulo (or possibly luolongjuna) did a lot of work on the <b>ping</b> 676command: pointed out min/range/max were out of order, 677that we shouldn't print a summary unless we received at least one 678reply packet, and implemented ttl support.</p> 679 680<p><u>Build plumbing</u>: 681The "make root CROSS=all" build announces each target in the title bar, puts 682its logs into root/log, and has better trap handling to stop with one 683ctrl-c.</p> 684 685<p>Fixed scripts/single.sh to work when PREFIX has no trailing slash, 686make silentoldconfig no longer feeds "y" to kconfig (which puts menus in a 687loop) and instead just feeds in newlines to accept whatever the default is. 688The non-git version number I keep forgetting to update each release moved 689from main.c to toys.h. 690Fixed a couple different errors in mkflags.c (one of which caused ls --color 691to set all the other flags).</p> 692 693<p>Elliott added more macos support and tests, and added 694fallocate, cp, mktemp, and mv to the macOS defconfig.</p> 695 696<p><u>Cleanup</u>: 697Rob did some cleanup on xargs, ls, md5sum, and sort, tidied up main.c a bit, 698made cp, base64, dmesg, and free use FLAG macros, 699and switched fallocate to new style global names. 700Elliott Hughes switched rfkill from the old byte at a time get_line() 701to libc getline(), made du use FLAG() macros, and mad chattr use 702standard toybox argument parsing for -v and -p. 703Several commands (help, cp) had sub-options removed from menuconfig. 704Merged realpath into readlink.c, and use xabspath() instead of libc realpath().</p> 705 706<p><u>Documentation</u>: 707New roadmap section about <a href=roadmap.html#packages>other packages</a> 708that toybox can (eventually) replace.</p> 709 710<p>Update roadmap to note that posix-2008 moved to a different URL (content 711at the old URL undergoes random changes), and link to the IETF RFCs. 712design.html explains more of the history of environment sizes on links 713and has a #bits anchor tag.</p> 714 715<p>Update the <a href=design.html#bits>LP64 section</a> of design.html to 716fish the documents out of archive.org now that unix.org is gone, 717and show the actual size table locally.</p> 718 719<p>Elliott improved the help of <b>date</b> and <b>chattr</b>, and 720made the usage: lines in the posix directory more consistent.</p> 721 722<p>Shrank the sed help from 150 lines to 90-ish.</p> 723 724<p><u>Tests</u>: 725New "txpect" performs interactive tests, running through a sequence of 726writes to a command's stdin and reads from stdout and stderr, when failing it 727reports the first non-matching step. (This for example lets sh.test check 728the shell line continuation logic prompts with $PS1 and $PS2 appropriately 729with various unfinished input lines, and that "echo hello; if" doesn't 730output hello before prompting for the next line of input.) Added 731VERBOSE=xpect to print out each read and write successfully performed by txpect.</p> 732 733<p>runtest.sh only creates an "input" file when the input argument isn't empty, 734EVAL doesn't supply -- (you have to provide your own if you want that).</p> 735 736<p>Rob added basic <b>stat</b>, <b>patch</b>, and <b>tee</b> tests. 737Jarno added a bunch of <b>vi</b> tests. 738Elliott fixed tests for <b>ifconfig</b>, <b>lsattr</b>, <b>chattr</b>, 739and <b>date</b>, added tests for find, id, xargs, and made 740the id, iconv, env, file, printf and cat tests work on macOS (and skipped 741the du tests there). Rob cleaned up chmod tests.</p> 742 743<p><u>Sheer pedantry</u>: 744true and false now have usage: lines (which you have to "help false" to see 745because they (intentionally!) don't support --help. 746Renamed get_chunk()/dump_chunk() to read_chunk()/write_chunk() in tail.c 747Elliott fixed some typos.</p> 748 749<a name="18-10-2019" /><a href="#18-10-2019"><hr><h2><b>October 18, 2019</b></h2></a> 750<blockquote> 751<p>"In those days spirits were brave, the stakes were high, men were real 752men, women were real women and small furry creatures from Alpha Centauri 753were real small furry creatures from Alpha Centauri." 754</p> <p>- The Hitchhiker's Guide to the Galaxy</p> 755</blockquote> 756 757<p><a href=downloads/toybox-0.8.2.tar.gz>Toybox 0.8.2</a> 758(<a href=https://github.com/landley/toybox/releases/tag/0.8.2>git commit</a>) 759is finally out (only two months late).</p> 760 761<p>The new commands this time are minor variants of existing ones 762(<b>dnsdomainname</b> is hostname -d, <b>arch</b> is uname -m), but about 7631/3 of toysh got implemented in pending, <a href=https://github.com/landley/mkroot>mkroot</a> got merged as a "make root" target (see Build), 764and Android's <a href=http://lists.landley.net/pipermail/toybox-landley.net/2019-August/010845.html>hermetic build</a> 765work continued resulting in a lot of fixes.</p> 766 767<p>The android-specific <b>getprop</b>, <b>setprop</b>, <b>start</b>, and <b>stop</b> 768commands were removed from toybox because they grew dependencies on android 769libraries, and since toybox tries to avoid mandatory external dependencies 770they moved to another package.</p> 771 772<p><u>Build</u>: 773The new "make root" target builds a simple toybox root filesystem, 774using scripts/mkroot.sh which is a stripped 775down version of the external <a href=https://github.com/landley/mkroot>mkroot</a> 776project merged into toybox. (Alas, at the moment it wants sh and route out 777of pending, which aren't quite load bearing yet.)</p> 778 779<p>The new "scripts/mcm-buildall.sh" convenience script builds cross 780compilers based on gcc+musl multiple targets (arm, x86, mips, m68k, s390, 781microblaze...) 782using <a href=https://github.com/richfelker/musl-cross-make>musl-cross-make</a>, 783and a new scripts/cross.sh to easily cross compile for one or more targets 784using the resulting compilers. (This works with "make root", "make 785toybox", and other builds understanding the CROSS_COMPILE environment variable.)</p> 786 787<p>Setting the environment variable ASAN=1 enables the 788llvm address sanitizer. (You may need to 789export ASAN_SYMBOLIZER_PATH on debian to use it, they add the version number to 790the filename in /usr/bin which confuses llvm.)</p> 791 792<p>Patrick Oppenlander fixed make -j (our make is a wrapper around 793scripts/make.sh which was already doing a parallel build, but if you called 794make with -j it wouldn't wait for make.sh to finish and the build broke).</b> 795 796<p>Lots of fixes for the MacOS build.</p> 797 798<p><u>New options</u>: 799We upgraded <b>tar</b> to extract some older tarballs, <b>file</b> added -b and -s 800options and can also recognize older tarballs, 801some xz archives, .otf fonts, perf/simpleperf data files, 802android boot images, and dtb files. Upgraded <b>file</b> to show the device type 803for block and char devices, the target for symlinks, and it says _why_ it can't 804open a file.</p> 805 806<p>Several commands ignore some options rather than erroring on them: 807<b>patch</b> ignores the -f -g# and --no-backup-if-mismatch options 808(all of which we were already doing by default anyway), and <b>xargs</b> 809ignores -P# (which requests parallel execution, maybe add it later but 810single threading works), and Denys Nykula made <b>wget</b> ignore 811--no-check-ceritificate and <b>gzip</b> ignore -n (again, we weren't doing 812either anyway) to satisfy pkgsrc.</p> 813 814<p>William Haddon taught <b>diff</b> and <b>patch</b> to support special characters in path 815names (via quoting) and more timestamp formats. 816Eric Molitor implemented <b>nl</b> -v (with negative and zero starting values), 817and fixed a MacOS compatibility issue in the build scripts. 818Tom Cherry added <b>netcat</b> -U (UNIX domain socket support). 819Denys Nykula taught <b>wget</b> to call ftpget for ftp:// URLs. 820Ethan Sommer added ln -t and rmdir --ignore-fail-on-non-empty. 821Elliott Hughes added <b>grep</b> -R, <b>killall</b> -w, tar --mode, 822 fixed <b>ls</b> -Z and spacing in -lZ and --full-time, 823added <b>xargs</b> --max-args and removed xargs -I (which we never actually 824supported) and tweaked the size calculation to more closely match other 825versions, 826added xargs -o and made -p read from /dev/tty, added <b>blkid</b> -s, SEC_TYPE for ext3, 827msdos, and ntfs, f2fs and ntfs LABEL, fixed vfat/ntfs UUID, and switched 828the endianness for UUID of msdos/ntfs/vfat, simplified the octal mode 829display in <b>lsof</b>, added <b>pidof</b> -x (thus making the default behavior _not_ 830be -x).</p> 831 832<p>When readdir() succeeds but stat() fails, <b>ls</b> now prints "??? ? ? filename" 833entries instead of "cannot access" errors. (Still trying to make ls / on 834android work more gracefully with the SELinux weirdness they added in 9.)</p> 835 836<p>Added %C to <b>stat</b> and made it show device type in its default output, 837<b>cmp</b> now works 838with 1 argument (implicit - as second argument reading from stdin). 839<b>sed</b> added exit codes to the q command (q123), added Q, and fixed a 840bad error message with "!". 841Removed TAIL_SEEK config option (it just always does that now), 842<b>find</b> grew several new options (%Z, -true, -false, and -newerXY), <b>ln</b> added -T. 843The argument to <b>mktmp</b> --tmpdir is now optional.</p> 844 845<p><u>Bugfixes</u>: 846The unshare probe bit-rotted so it was impossible to build <b>unshare</b> 847and <b>nsenter</b> on some distros. 848Commit 771e94e2a08 broke toybox's ability to say "unknown command" when 849you pointed a symlink at it that it that didn't correspond to a command, 850pointing a symlink at another symlink 851to make toybox run a command under a name it doesn't recognize 852(ln -s toybox sh; ln -s sh ash) had an off by one error, 853<b>ifconfig</b> no longer error_exits if the "read mac address" ioctl fails (Android N 854and later block that for non-root users to prevent device tracking). 855When the libcrypto library was disabled, md5sum was building commands it 856hasn't got built-in support for yet (like sha3sum) which acted like redundant 857copies of md5sum, 858<b>tar</b> wasn't correctly reading or writing sparse files with a hole at 859the end, and tar tzf blah.tar.xz was calling xz when it meant xzcat, 860<b>xargs</b> would spuriously fail on large memory systems (due to a missing 861"unsigned" in a typecast), 862<b>basename</b> can now remove suffixes starting with a dash, 863<b>cp</b> -r unlinks() an existing symlink before trying to 864recreate the symlink (otherwise cp -r into an existing directory will 865try to follow the existing symlink and create another symlink at its 866destination, failing if a file already exists there, which 867was confusing gentoo's package manager), <b>timeout</b> now produces the 868right exit code when the timed command intercepts the exit signal, 869and <b>hostname</b> -d no longer segfaults on machines with no domain name.</p> 870 871<p>Denys Nykula fixed the <b>ftpget</b> freeze (it was sending REST instead 872of RETR), made <b>mv</b> work with a trailing slash in the source, 873fixed a <b>find</b> segfault, 874and made <b>env</b> always exec rather than recursing to a builtin 875(on the theory #!/usr/bin/env is expected to search the $PATH).</p> 876 877<p>Elliott improved <b>killall</b>'s handling of long filenames, made <b>kill</b> work 878when killall5 is disabled (missing FORCE_FLAGS), fixed error reporting in 879<b>hostname</b>, fixed several things in <b>xargs</b>, 880made <b>printf</b> \c and \0 octal escapes work, fixed a <b>find</b> -name corner 881case (find src/*.c -name file.c) and find dangling symlink behavior, 882made some <b>rm</b> error messages consistent, fixed \x behavior in echo and 883printf, fixed linestack.c's buffer length for utf8 U+XXXX escape printing, 884fixed a race in <b>losetup</b>, fixed <b>grep</b> -F with multiple matches on the same 885line and an -I failure in the existing grep tests, made <b>readlink</b> notice 886when it has more than one argument, and made various 887fixes to <b>modinfo</b>.</p> 888 889<p>Ethan Sommer reported that <b>stat</b> of an suid/sticky file output 5 digits of 890octal stat date instead of 4. 891Rob fixed an unaligned access in <b>grep</b>. Alessio Balsini removed an incorrect 892null termination in <b>losetup</b>. 893Jarno Mäkipää fixed <b>hexedit</b> 894scrolling up and down on older terminals, and fixed <b>ls</b> segfaulting with a broken 895(non-UTF8) locale (didn't expect wcrtomb to return -1). 896Andrew Ilijic made ls put 2 spaces between columns like other implementations 897(which helps when terminals get confused and apply UTF8 combining characters 898to the space after a filename). 899</p> 900 901<p><u>Library</u>: 902Added dlist_lpop() to use a dlist as a stack (it removes the last entry 903instead of the first), and dlist_pop() now works on a dlist_terminate()d list. 904DIRTREE_STATLESS returns entries we couldn't stat() (with a zeroed ->st 905field, and ->again |= 2), but filling in the file type from readdir(). 906Coversions between signal names and numbers now include all the Linux signals, 907not just posix ones. The functions sig_to_num() and num_to_sig() moved into 908lib/portability.h, because MacOS has different signals. 909TOYFLAG_MAYFORK allows commands to run in toysh's process without forking, 910but also makes them accessable from the toybox multiplexer or standalone. 911A MAYFORK command has to clean up after itself (even in error paths) and 912can't discard anything we need to keep (such as closing stdout).</p> 913 914<p>Elliott did a big xbind/xconnect cleanup (adding xbindany and xconnectany), 915taught xregcomp that an empty regex matches the whole line 916(because FreeBSD, and thus MacOS, doesn't already do that), and 917replaced several uses of get_line() (which does single byte reads) 918with getline() (which doesn't).</p> 919 920<p><u>Plumbing</u>: 921"make clean" doesn't produce a screenful of unnecessary output now, 922rm, ln, cp, kill, and netcat use the FLAG() macros now, makedevs uses the new 923GLOBALS naming format, timeout now uses xwaitpid(), and we fixed an 924off by one error in xwaitpid().</p> 925 926<p>Elliott removed a workaround for old NDK versions from getconf and 927moved sort off of get_rawline() (which let us remove it). 928Rob undid some loop unrolling in md5sum/sha1sum (we have libcrypto if you want 929an assembly optimized version instead of an understandable version).</p> 930 931<p>Android ndk-r20 doesn't define the __ANDROID_NDK__ symbol, so we switched 932to using clang's __has_include() (which is an undefined macro and thus a NOP 933resolving to false on gcc).</p> 934 935<p><u>Pending</u>: 936Rob did a lot of work on toysh: continuation support works (it knows when to ask 937for another line of text and when to run what it's got), as do 938nested if/else/elif statements, and while and for loops (supporting "for i" 939and "for i in", but not for ((;;)) yet). 940It parses pipes and redirections but doesn't perform them yet. 941The next big todo chunk is environment variable resolution. 942</p> 943 944<p>Gavin Howard fixed some bugs in bc, such as not returning error when raising 945zero to a negative power. 946Jarno Mäkipää continues to extend vi, adding yank and push, support for tabs, 947rewriting delete, changing the drawing code, etc. Elliott also added several 948fixes and features to vi, 949fixed host to cope with large DNS responses, switched crontab to 950use getline(), did work on man, fixed fixed several things in dd, 951implemented diff --strip-trailing-cr and made diff not need /tmp. 952Mike Bennett added extended attribute support to ip.c's route change.</p> 953 954<p><u>Test suite</u>: The killall and pgrep tests were having occasional 955spurious failures due to a race condition (the test script would fork() 956to call sleep and for just a moment there were two instances of the test 957script, reporting an extra process if killall or pgrep ran then). 958 959<p>Elliott Hughes did a lot of work on the test suite: add kill -l tests, 960make losetup.test notice (and skip) if loopback 961devices area already in use, blkid.test can TEST_HOST e2fsprogs blkid now, 962modinfo.test notices (and skips) if there's no /proc/modules or modules 963directory, ifconfig.test skips if "dummy0 up" fails and disabled the 964pointtopoint tests entirely (the kernel never supported it?), 965truncate.test is less 966confused by SELinux, hostname.test can run some tests as non-root, 967addressed a race condition in killall.test on slow systems, 968made chgrp.test, chown.test, and tar.test handle an empty /etc/passwd or /etc/group 969(we were checking whether they were _there_ but some android devics have 970empty ones), 971fixed a couple things in env.test, extended killall.test to explicitly cover 972long and short names (and not assume the shell is /bin/sh), taught split.test not to rely on bash process substitution, 973added missing TZ=utc to touch.test, fixed cp.test to pass for root 974or with a restrictive umask, and fixed the FAILCOUNT arithmetic to use more portable 975$(()). Elliott also made some tests more flexible (find.test can handle any 976error message about symlink loops, etc), and disabled others (such as du) 977when SELinux is enabled.</p> 978 979<p>Rob taught testcmd not to use the shell builtin for TEST_HOST unless there 980isn't one in the $PATH, work if $PWD has a space in it, 981and make kill.test stop testing the shell builtin 982insead of the command, quieted tests that were producing output 983other than their PASS/FAIL line, and made NOSPACE tests ignore the 984presence/absence of leading/trailing whitespace as well as differences 985in the amount of space.</p> 986 987<p><u>Documentation</u>: 988The <a href=roadmap.html>roadmap</a> got freshened up a bit, with updates 989for android from Elliott. 990In <a href=design.html>the design page</a> the Features section starts with 9914 new paragraphs about the scope of toybox, and a new License section talks 992about 0BSD. 993The "./toybox --help" output now explains how to do install_flat by hand.</p> 994 995<p><u>Sheer pedantry</u>: 996Elliott fixed a double close in loopfiles_lines() so strace doesn't 997have an EBADF in it, and added a missing "static" in lib/net.c.</p> 998 999<a name="21-05-2019" /><a href="#21-05-2019"><hr><h2><b>May 21, 2019</b></h2></a> 1000<blockquote>
1001<p>"I like the cover," he said. "'Don't Panic.' It's the first helpful or intelligible thing anybody's said to me all day."</p> <p>- The Hitchhiker's Guide to the Galaxy</p> 1002</blockquote> 1003 1004<p><a href=downloads/toybox-0.8.1.tar.gz>Toybox 0.8.1</a> 1005(<a href=https://github.com/landley/toybox/releases/tag/0.8.1>git commit</a>) 1006is out.</p> 1007 1008<p>Android is now using toybox as part of a <a href=http://lists.landley.net/pipermail/toybox-landley.net/2018-November/009824.html>"hermetic" build</a> 1009(meaning Android is building under toybox, which is halfway to Android 1010building under Android). See Android's <a href=https://android.googlesource.com/platform/prebuilts/build-tools/+log>build-tools</a> and <a href=https://android.googlesource.com/platform/build/soong/+log>soong</a> repositories to follow along with development, or check the list for the <a href=http://lists.landley.net/pipermail/toybox-landley.net/2019-May/010485.html>current status</a>.</p> 1011 1012<p><u>New commands</u>: Isaac Dunham added <b>mcookie</b>, which is used by 1013X11. Elliott Hughes added <b>devmem</b>, which replaces toolbox's "r".</p> 1014 1015<p><u>Promoted</u>: <b>tar</b>, <b>gunzip</b>, and <b>zcat</b> were cleaned 1016up and moved out of pending. 1017Tar is a near-rewrite with support for --owner --group and --sparse, 1018capable of autodetecting "wget blah.tar.bz2 -O - | tar xv", a --restrict option 1019that only allows files to extract into a single subdirectory, and so on.</p> 1020 1021<p><u>Added to pending</u>: 1022Jarno Mäkipää contributed a new <b>vi</b> implementation. Makepost added 1023<b>man</b>.</p> 1024 1025<p><u>Updates</u>: Elliott added <b>find</b> -wholename/-iwholename, -printf, 1026and -context, <b>grep</b> --exclude-dir, and <b>echo</b> -E. 1027Rob added <b>blkid</b> -U and -L, <b>mount</b> now has UUID= support via blkid -U, 1028you can now specify TZ="blah" in the <b>date</b> -d input string (although 1029why the double quotes are required is an open question), and <b>sed</b> now 1030understands ,+N relative ranges. Makepost added <b>rm</b> -v. 1031The human_readable fields in <b>ps</b>/<b>top</b>/<b>iotop</b> now use all 1032available space to show more precision, <b>iotop</b> displays swap bandwidth 1033properly (it was showing a signed field as unsigned), and 1034<b>touch</b> -t and -d autodetect the time format.</p> 1035 1036<p><u>Cleanups</u>: In pending Rob did some bc cleanup, 1037Colin Davidson did some arp cleanup, 1038Uros Prestor fixed route argument parsing, and 1039in bc Daniel Rosenberg fixed bc_vec_concat()'s allocation and 1040Gavin Howard fixed an overflow bug in bc_num_ulong().</p> 1041 1042<p>Elliott made scan_key() detect cursor keys and such with several more 1043terminal types, made more better about directories and non-tty output, 1044cleaned up inconsistent uses of ARRAY_LEN(), taught file 1045to recognize a c-sky ELF machine, and fixed timezone and daylight 1046savings time issues in date and its tests. 1047Rob simplified netcat and ping using new lib/net.c infrastructure. 1048When run as non-PID 1 (for a chroot) oneit's exit code now indicates 1049which signal it's exiting due to. 1050Hadrian Węgrzynowski #defined constants for mkpathat. 1051Date now uses the current time for unspecified fields (instead of zeroing 1052them), and should set the weekday properly. 1053Sort's -k2.3,4.5 syntax is now documented and behaves more closely to 1054other implementations (silly as that behavior is). 1055Significant speedup to sed s/a/b/g on a megabyte long line (it was 1056O(n^2) and now it's quite snappy).</p> 1057 1058<p>Several cases of warning about stdout failing to write were silenced 1059because things like piping the output to head means stdout is a special 1060case: its output is often discarded and that's fine. And xprintf() 1061and friends only checks stdout for errors so it can exit early ("yes | head" 1062should not spin endlessly) without actually flushing anything. 1063There's an ongoing design debate about line buffering stdin and stdout 1064that'll have to be resolved next dev cycle.</p> 1065 1066<p><u>Bugs</u>: 1067Elliott sent in a lot of fixes for building AOSP with toybox: 1068support for more date formats, sed substitution of empty capture groups 1069and an endless loop with -EPIPE, fixed find -path/-ipath, made loggit() 1070only feed LOG_AUTH to syslog when we have a tty, gave grep a bunch 1071of --longname synonyms for short options, added getfattr --only-values, 1072and timeout --foreground --preserve-status and --signal.</p> 1073 1074<p>Top got a lot of tweaks: it no longer collates thread's CPU usage into the 1075parent thread (in -H mode), hides the cursor in interactive mode, updates the 1076display properly in batch mode, and accepts ENTER 1077as a synonym for SPACE when refreshing the display. The header lines 1078now abbreviate long numbers with units (via human_readable()), 1079more reliably spans the terminal width, and says "Thread" instead 1080of "Task" when it's showing threads. The task/thread count now adds up 1081(understanding more kernel states and treating unknown ones as "sleeping"). 1082Top now treats -o "" as an error (previously it displayed an empty screen).</p> 1083 1084<p>William Djupström pointed out login needs to chown() the tty, and made it 1085clear the environment when -p is absent. 1086Vidar Holen fixed inverted find -exec exit status. 1087Rob made chgrp() stop relying on libc's printf("%s", NULL) printing "(null)" 1088because a <a href=https://github.com/varnishcache/varnish-cache/issues/2879>newly added gcc bug</a> turns that into a build break, and 1089fixed an outright embarassing xstrndup() bug. 1090Liwugang fixed a segfault when stat's format string had a trailing %. 1091A missing else in grep meant -x was sometimes ignored.</p> 1092 1093<p><u>Infrastructure</u>: 1094in the build scripts/portability.sh now tests that the compiler it's trying 1095to use exists up front. We no longer link against librt because on glibc that's 1096pulling in libpthread for some unknown reason.</p> 1097 1098<p>TOYFLAG_ARGFAIL() lets commands return custom exit values when option parsing 1099fails (because AOSP build scripts cared), so timeout --unknown returns 125 1100and so on: chroot, diff, cmp, env, grep, nohup, and sort also use it now with 1101various values.</p> 1102 1103<p>New FLAG() macros: FLAG(x) expands to (toys.optflags&FLAG_x) and returns 1104zero if the command line argument's bit isn't set and nonzero if it is 1105(meaning -x was or wasn't encountered on the command line this time by 1106lib/args.c). Lots of commands got converted to use them.</p> 1107 1108<p>New lib/env.c with reset_env(), xsetenv(), and xunsetenv() which frees 1109the old environment variable when it wasn't inherited from exec(). This 1110lets long-running loops reset environment variables without memory leaks.</p> 1111 1112<p>New xnotify() plumbing in lib/portability.c with Linux and Mac versions 1113(which should also work on BSD).</p> 1114 1115<p>New xparsedate() and xvali_date() functions allow date, tar --mtime, and 1116touch to understand the same date formats, 1117xpopen_both() now knows how to use existing filehandles for the child's 1118stdin/stdout, and no longer redirects stderr (which hides errors), 1119new nanomove(), nanodiff(), union socksaddr, xrecvwait(), 1120and human_readable_long() to show more than 3 digits of output.</p> 1121 1122<p>Taught xgetaddrinfo() to return a wildcard address for a NULL host, 1123xconnbind() sets SO_REUSEADDR by default, 1124fileunderdir() returns the abspath to the file now (since we had to work 1125it out anyway), and 1126xabspath() uses O_PATH now (because Android's SELinux rules got more aggressive).</p> 1127 1128<p>Several new xsendfile() variants, including sendfile_len() to copy 1129a specific amount of data and xsendfile_pad() to append zeroes to the 1130output when there isn't enough input.</p> 1131 1132<p>regexec0() is now using libc's REG_STARTEND supported by every libc out 1133there _except_ musl. (It originated in BSD and was adopted by glibc, bionic, 1134and uClibc 15 years ago, and is also supported in macosx. Musl's maintainer 1135<a href=https://www.openwall.com/lists/musl/2013/01/15/26>turned down</a> 1136the feature request as an invalid use case he didn't think they should 1137be trying to do.)</p> 1138 1139<p><u>Docs</u>: 1140the <a href=license.html>license page</a> now has an SPDX identifier, and links to more 1141history/context. The actual LICENSE file had its title line removed 1142so <a href=https://github.com/github/choosealicense.com/pull/643#issuecomment-463746027>github could recognize it</a> as 0BSD. (We're still waiting for 1143"<a href=https://github.com/github/choosealicense.com/pull/643#issuecomment-464380789>a while</a>" to pass before github actually does, though.)</p> 1144 1145<p>A new www/doc/mount.txt file describes how mount works under the covers.</p> 1146 1147<p>Rob consistently misspelled "canonical" and "millisecond", mountpoint 1148has a synopsis now, 1149Kevin van der Kamp fixed a typo in netstat's help text, and Elliott 1150Hughes fixed typos everywhere and made the tense, capitalization, and 1151punctuation of help text more consistent.</p> 1152 1153<p>New paragraph in the code style part of design.html explaining that 1154"char* a, b;" is not how C works, and since you wind up with "char *a, b;" 1155anyway you might as well say that.</p> 1156 1157<p>Given dreamhost's tendency to repeatedly delete the mailing list 1158archive, the nav bar on the left links to a backup web archive now too.</p> 1159 1160<p>The FAQ now says why we do time based releases.</p> 1161 1162<p><u>Testing</u>: Added VERBOSE=nopass to not show passing tests. 1163The test suite now does an rm -rf on testdir between each command so 1164debris files don't accumulate. 1165New skipnot function skips the next test if a command line fails, and 1166toyonly function only runs command when we're testing the toybox version 1167of command. (This isn't the same as TEST_HOST, the host version could be 1168toybox.) 1169The find -newer test calls "sleep .1" to avoid intermittently failing with an 1170identical timestamp. 1171Elliott added the start of a file.test rogues gallery. 1172No longer call lsattr in "make tests" because the behavior differs by 1173filesystem and it needs fixing somehow.</p> 1174 1175<a name="08-02-2019" /><a href="#08-02-2019"><hr><h2><b>February 8, 2019</b></h2></a> 1176<blockquote> 1177<p>"Most readers get as far as the Future Semiconditionally Modified 1178Subinverted Plagal Past Subjunctive Intentional before giving up; and 1179in fact in later editions of the book all pages beyond this point have 1180been left blank to save on printing costs."</p> 1181<p>- The Hitchhiker's Guide to the Galaxy</p> 1182</blockquote> 1183 1184<p><a href=downloads/toybox-0.8.0.tar.gz>Toybox 0.8.0</a> 1185(<a href=https://github.com/landley/toybox/releases/tag/0.8.0>git commit</a>) 1186is out.</p> 1187 1188<p>Toybox now builds on MacOS and FreeBSD, thanks to the efforts of Elliott 1189Hughes and Ed Maste respectively. Use the "make macos_defconfig" and "make 1190freebsd_defconfig" targets to enable the set of commands that compile on 1191each so far.</p> 1192 1193<p><u>New commands</u>: Added an <b>sntp</b> client/server (RFC 4330 Simple Network Time 1194Protocol, a compatible subset of ntp). The <b>test</b> command was rewritten 1195and promoted out of pending.</p> 1196 1197<p><u>New options</u>: <b>grep</b> now has --color, supports embedded NUL bytes in its input, 1198recognizes binary files, and passes all of grep.test (in case you 1199needed the middle numerical field of -bB, etc). 1200Josh Gao added ipv6 and UDP support to <b>netcat</b>. 1201Volodymyr Medvid reported that install -d doesn't honor -o or -g. 1202Elliott Hughes did a lot of work to support hermetic Android/AOSP builds: 1203<b>mkdir</b> accepts both --parent and --parents as synonyms for -p, <b>touch</b> ignores -f, 1204<b>basename</b> added -s to remove a trailing suffix, <b>dirname</b> now supports multiple 1205arguments, <b>cmp</b> accepts --quiet and --silent as synonyms for -s, <b>hostname</b> 1206added -sfd, <b>head</b> added --bytes as a synonym for -c and --lines as a synonym 1207for -n, <b>mktemp</b> added -t and fixed -u, <b>sed</b> added -z and -iEXT to keep backup files, 1208<b>md5sum</b> and sha1sum added --status and --check as synonyms -s and -c, 1209<b>readlink</b> added --canonicalize as a synonym for -f, <b>sort</b> grew -V, 1210<b>patch</b> added -s its synonym --quiet, <b>stat</b> added --format as 1211a synonym for -c, <b>xargs</b> added -p -t -r, 1212Eduardas Meile asked 1213that <b>umount</b> ignore -c. Reverend Homer added a small optimization to file.c, 1214and Elliott taught <b>file</b> to recognize riscv ELF binaries. Peter Collingbourne 1215taught <b>ls</b> -t to use the nanoseconds field. 1216<b>patch</b> has better support for patching a file with a tab in the name.</p> 1217 1218<p><u>Bugfixes</u>: 1219<b>cp</b> --preserve was segfaulting when you didn't specify _what_ to 1220preserve (it now correctly defaults to "mot") and didn't get the permissions 1221right when copying a symlink's contents as a regular file, 1222<b>sort</b> -x didn't work when 1223attached to a key, <b>host</b> didn't allocate a big enough buffer for worst 1224case ipv6 address size, <b>sed</b> needed a ; between b and } when other 1225implementations don't (we're already well past what posix says but a script 1226out in the field broke...), 1227and several fixes to <b>hostname</b> in a container, <b>ps</b>/<b>top</b> were 1228misreading the VIRT and SHM fields.</p> 1229 1230<p><u>Pending</u>: Gavin Howard updated <b>bc</b> and added more tests, 1231Marius Adaskevicius pointed out <b>mdev</b> -s should follow symlinks, 1232Yangchun Fu reported a <b>dhcp</b> checksum bug, <b>modprobe</b> needed errno reset 1233to avoid reporting spurious errors in verbose mode and no longer 1234exits with status 1 if it can't find /etc/modprobe.conf, the <b>more</b> command 1235wasn't always flushing stdout when it exited.</p> 1236 1237<p><u>Build</u>: 1238<b>chrt</b> no longer #warns about the musl sched_get_priority_min() bug, but 1239instead works around it. 1240We were mixing setjmp/siglongjmp (harmless in some contexts but it kind 1241of annoyed FreeBSD), and 1242make install_airlock now adds sha256sum (because the Linux 4.20 build now 1243needs that for the s390x target).</p> 1244 1245<p><u>Coding style</u>: 1246Rob converted the rest of the option GLOBALS() to the new single letter 1247coding style, and the new FLAG(x) macro is a slightly tidier way to say 1248"toys.optflags&FLAG_x". 1249Removed CFG_SORT_BIG (the sort command always 1250has the full functionality now. The general future direction or toybox 1251is to either have a command or not have it; multiple versions of the 1252same command aren't worth the complexity in testing, documentation, 1253or system adminstration).</p> 1254 1255<p><u>Library code</u>: 1256The mkflags plumbing can now support arbitrary punctuation as option 1257names via an escape syntax (because mkfs.vfat specifies an offset with -@), 1258and lib/args.c now only sets FLAGS_NODASH when the first argument 1259didn't have a dash (allowing "ps ax" and "ps -ax" to behave differently).</p> 1260 1261<p>Added an xrename() function, 1262xchdir() has better error reporting, xconnect()/xbind() had their 1263implementations merged, xsendto() moved from ping to lib, xpoll() now 1264measures elapsed time and only waits for the remaining period when restarted, 1265and Eduardas Meile converted several error_exit() to error_exit_raw() (because 1266yocto 2.6 buils with -Werror=format-security by default).</p> 1267 1268<p>There's a scripts/portability.sh now which lets the build use gsed and gmake 1269(when available) in more places to avoid broken host versions on MacOS and FreeBSD. 1270The syntax of the "noreturn" attribute 1271changed slightly, some calls to strnstr() were replaced with strcasestr(), 1272we work around MacOS' lack of features.h, portability.h can now do Apple's 1273endianness macros, and so on.</p> 1274 1275<p>Following the <a href=faq.html#support_horizon>seven year rule</a> 1276Elliott removed support or glibc 2.10, and also 1277reformatted a lot of --help text for consistency (removing trailing 1278periods and such).</p> 1279 1280<p><u>Test suite</u>: 1281The test suite now has its own version of "pending", specifically "make tests" 1282skips test files without the executable bit set (unless you export $TEST_ALL). 1283This eliminates "expected failures" (I.E. files with unresolved todo items) 1284from the global regression test. Additional tests can be added to the global 1285regression test with chmod +x as the todo items they document get resolved.</p> 1286 1287<p>Several places the test suite got fluffed out, including guards to skip 1288root-only tests when run as a normal user. The testcmd function prints the 1289short name instead of the full path to the command. 1290The tests for the test command 1291("test.test") no longer test the shell builtin but correctly test the 1292toybox command. (Now say that ten times fast.)</p> 1293 1294<p>Bash version skew required replacing "continue" with "return" to stop 1295tests early in bash 4.4 (for VERBOSE=fail).</p> 1296 1297 1298<a name="31-10-2018" /><a href="#31-10-2018"><hr><h2><b>October 31, 2018</b></h2></a> 1299<blockquote><p> 1300"In the beginning the Universe was created. 1301This has made a lot of people very angry and been widely regarded as a bad move."</p><p>- The Hitchhiker's Guide to the Galaxy 1302</p> 1303</blockquote> 1304 1305<p><a href=downloads/toybox-0.7.8.tar.gz>Toybox 0.7.8</a> 1306(<a href=https://github.com/landley/toybox/releases/tag/0.7.8>git commit</a>) 1307is out (a month late).</p> 1308 1309<p>Toybox <a href=http://lists.landley.net/pipermail/toybox-landley.net/2018-October/009769.html>now builds</a> with the Android NDK (r18 release), almost out of the box. 1310You have to add an "llvm-cc" symlink to "clang", then use CROSS_COMPILE=llvm- 1311with the appropriate $PATH (or absolute path in CROSS_COMPILE) for the 1312target you want to build for. (To run it on a non-android host, you probably 1313want "LDFLAGS=--static" too.)</p> 1314 1315<p><u>New commands</u>: <b>i2cdetect</b>, <b>i2cdump</b>, <b>i2cget</b>, and <b>i2cset</b> 1316courtesy of Elliott/Android. The <b>watch</b> command got a complete (tty-aware) 1317rewrite, and was promoted out of pending. The <b>prlimit</b> command is back 1318(a configuration bug was always disabling it), and <b>ascii</b> now defaults y 1319in defconfig (an oversight).</p> 1320 1321<p><u>New options</u>: 1322The <b>ifconfig</b> command added -S (short view) giving one line of 1323information per interface, in "name ipv4/mask macaddr [ipv6/mask@type...]" 1324format. <b>grep</b> grew binary file detection, with -I and -a options to 1325ignore them or force treating them as ascii (really utf8). 1326Zach Van Rijn asked for <b>find -empty</b>. 1327In the <b>file</b> command, Elliott improved java 1328.class support and added .wav, .bmp, and android .dex. 1329Elliott also added "getconf -a" and a lot of missing getconf symbols the 1330AOSP build uses, including support for pathconf(3) symbols requiring two 1331arguments. This means getconf's arguments work more like ubuntu's 1332now (one or two arguments, not iterating through the supplied list and 1333processing each like last release), and -l grew section identifiers (so 1334the "getconf -l" output is no longer a directly consumable list of symbols 1335it takes). 1336Command line options specifying durations (like top -d or ping -i) can 1337now use fractions and units, like "1.5" and ".1m". See "toybox --help" for 1338details. 1339Toybox now dereferences one layer of symlinks if it doesn't recognize the 1340name it's called under (so if you "ln -s $(which sleep) blah" and then 1341"./blah 30", it should figure out you mean sleep 30).</p> 1342 1343<p><u>Pending</u>: 1344Gavin Howard contributed a large new <b>bc</b> implementation to pending, 1345which covers everything the kernel build needs (and more) but is going to 1346take a while to review. 1347In <b>diff</b> the android guys added --color and timestamps on the 1348+++/--- lines. In <b>mdev</b> Faustas Azuolas Bagdonas added support 1349for mdev.conf's fourth field. Reverend Homer suggested an error message 1350improvement in <b>wget</b>, Kevin Spiteri did a cleanup pass on test.c, 1351and there was a cleanup pass on the passwd command.</p> 1352 1353<p><u>Bugfixes</u>: 1354Elliott responded to a bug in <b>getconf</b>'s sed-based header generation by 1355replacing it with a more conventional array of #defined symbols, with #ifdefs 1356for missing symbols on the three libc implementations (glibc, bionic, musl) 1357we've tested so far. (This requires portability.h work to add new supported 1358build environments, but at least it works on bionic now.) 1359The <b>file</b> command now fails gracefully when reading pathologically 1360broken ELF files (the tests for integer overflow missed one), and 1361<b>date</b> no longer shows a meaningless errno when it can't parse the 1362date format. 1363Several fixes in <b>ping</b> (-w and -W didn't work, -c kept sending packets 1364while waiting for replies, and when no reply packets were received the summary 1365data was printed twice). 1366Elliott fixed <b>wc</b> column widths (traditional reality doesn't match 1367posix), fixed <b>modprobe</b>'s error handling (reported by Wen Xie), and 1368also fixed the units on blockdev --blkraget (reported by Martijn Coenen). 1369Several small fixes to the <b>stat</b> command's output (help text, quoting 1370style, leading zeroes, switch -f from %t to %T), <b>oneit</b> no longer 1371reboots the system when it's not called as PID 1. 1372Last release's commit letting $STRIP be redefined had a typo. 1373Nick Kralevich added an istty() check before calling TIOCGWINSZ (which 1374triggered Android's strict ioctl filtering on non-filesystem fifos). 1375An unstripped build (where the "strip" command fails for a given 1376CROSS_COMPILE) will now overwrite the (read-only) output file instead of 1377failing a rebuild. The dirtree plumbing no longer prints a "No" on front 1378of the filename in error messages (such as "permission denied").</p> 1379 1380<p><u>Docmentation</u> 1381Elliott updated the roadmap with Android AOSP status, towards turning that 1382into a hermetic build (hopefully with an eventual self-hosting option, work 1383is <a href=b33d37d6f735>already underway</a> on the airlock step). 1384Rob added a little more context for LSB and described the move from Aboriginal 1385Linux to mkroot. 1386The <b>ps</b> help text changed: now "ps -o help" shows the fields and the normal 1387--help is much more manageable. Ifconfig's --help text also got tidied up. 1388Our LICENSE file has the SPDX identifier (0BSD) now, and the note about 1389the kconfig/ subdirectory still having (build only, non-shipping) GPL code 1390in it moved into the kconfig subdirectory.</p> 1391 1392<p><u>Coding style change:</u> 1393GLOBALS() now uses the argument letter as the variable 1394name for variables automatically set by command line arguments via lib/args.c, 1395and no longer requires they be one per line. 1396Removed use of the gcc 1397\e extension in string constants, replacing it with \033.</p> 1398 1399<p><u>Library code:</u> 1400lib/interestingtimes.c was renamed to lib/tty.c. 1401The deflate code from toys/pending/compress.c moved to lib/deflate.c, 1402which gunzip.c now uses when it's not configured to use zlib. (This reduces 1403the bootstrap dependencies for the "airlock" step of a hermetic build.) 1404The compression side remains a todo item. 1405Added "%" to lib/args.c reading seconds (including fractions/units) into a 1406long milliseconds argument. Redid xparsetime() to not need floating point, 1407added xparsemillitime() for milliseconds common case, and 1408parsetime() now treats leading garbage as an error instead of returning zero. 1409The bufgetpwuid()/pufgetgrgid() functons can now handle more than 4k of group 1410data. The set_terminal() function can now set serial speed, and microcom.c 1411uses it. Added xsignal_flags(), and more consistently use xsignal() (which wraps 1412sigaction()) instead of signal(). 1413A new xgetrandom() function calls the new getrandom() system call, falling 1414back to /dev/urandom on older kernel/libc (made to actually _work_ by 1415Patrick Oppenlander).</p> 1416 1417<p><u>Build infrastructure:</u> 1418Updated dependency detection so "make distclean defconfig toybox" now works 1419all on the same command line. (This is nice when $CROSS_COMPILE changes). 1420scripts/config2help.c no longer includes parts of lib/ and just copies what 1421it needs into itself, improving build portability. 1422The build now checks the specified cross compiler exists, hopefully providing 1423a more informative error message when it doesn't. Similarly, when .config is 1424missing the error message suggests running make defconfig.</p> 1425 1426<a name="23-06-2018" /><a href="#23-06-2018"><hr><h2><b>June 23, 2018</b></h2></a> 1427<blockquote> 1428<p>There is a theory which states that if ever anyone discovers exactly what 1429the Universe is for and why it is here, it will instantly disappear and be 1430replaced by something even more bizarre and inexplicable. There is another 1431theory which states that this has already happened.</p> 1432<p> - The Hitchhiker's Guide to the Galaxy</p> 1433</blockquote> 1434 1435<p><a href=downloads/toybox-0.7.7.tar.gz>Toybox 0.7.7</a> 1436(<a href=https://github.com/landley/toybox/releases/tag/0.7.7>git commit</a>) 1437is out.</p> 1438 1439<p><u>New commands</u>: Rob Landley added <b>getconf</b>, Elliott Hughes added 1440<b>uuidgen</b>, and <b>ping</b> and <b>fmt</b> were promoted out of pending.</p> 1441 1442<p><u>New options</u>: The <b>cp</b> command added the --parents option, 1443<b>readlink</b> now has -m to show where a missing path would be, 1444<b>netstat</b> got some updates (better nommu support, it can use /etc/services 1445names, more command line options are bounds checked), 1446Ng Zhi An added --getra and --setra (get/set readahead) to <b>blockdev</b>, 1447Elliott Hughes added <b>xxd</b> -o and made <b>top</b> -d understand fractional 1448sections (because the Linux Test Project uses that), and 1449Minghui Liu added <b>watch</b> -b.</p> 1450 1451<p><u>Bugfixes</u>: Several fixes to <b>vmstat</b>: Elliott Hughes made it work on a 145248-core machine 1453and fixed a glitch with -n, Haroon Maqsood pointed out "vmstat 1 1" didn't 1454stop and "vmstat -n" didn't print the first theader line. 1455Minghui Liu fixed a bug where <b>cp</b> -p didn't preserve 1456timestamps, and pointed out the b, c, and d suffixes on numbers weren't 1457working. Ryan Pritchard pointed out that <b>du</b> -d0 should act like du -s. 1458Filip Perich made an RFC2347 OACK compliance fix to <b>tftp</b> in pending. 1459Zach van Rijn fixed a bug in <b>xxd</b> causing incorrect translation of 1460uppercase characters. 1461Elliott fixed several things in <b>top</b> (removed spurious '\r' characters from -b 1462output, removed interactive flicker, made running processes bold), and 1463pushed Rob to make <b>file</b> work better recognizing things on stdin 1464("cat /bin/ls | file -" still won't work but "file - < /bin/ls" should). 1465Rob fixed a bug in <b>netstat</b> on 64 bit big endian systems, 1466and fixed <b>cut</b> -DF 1467(a posix compliance fix broke its ability to act as a decent awk replacment 1468because outputting all delimiterless lines isn't what you want there, -D 1469now disables that too).</p> 1470</u></p> 1471 1472<p><u>Documentation</u>: Rob added a buildroot section to the roadmap with the 1473prequisites that needs to run, and reformatted more of the ps --help text 1474to two columns.</p> 1475 1476<p><u>Library</u>: 1477FLAGS_NODASH is now set in toys.optargs when an optstring starting 1478with & has no dash in its first argument. (This lets "ps -ax" and "ps ax" 1479behave differently.) Factored out xtestfile() into lib/. 1480The comma-separated-list parsing infrastructure moved to lib/commas.c. 1481Added mkpath() for the common case of mkpathat() and #defined MKPATHAT_* 1482constants for the uncommon cases. Elliott added better error checking 1483to xparsetime() and fixed a bug in names_to_pid() (used in <b>pidof</b> 1484and <b>killall</b> and such). 1485Rob inlined the old toys/e2fs.h into pending's mke2fs, 1486and removed a rogue semicolon from the WOULD_EXIT() macro that screwed 1487up if() statement levels. The do_lines() semantics changed adding a 1488callback(0,0) at the end of each file.</p> 1489 1490<p><u>Tests</u>: 1491The test_* commands under toys/example were all renamed demo_* so 1492they don't share a namespace with running a standalone command 1493through the test suite (ala "make test_sed"), then 1494demo_human_readable became demo_number so it can also test atolx() 1495suffixes. The readlink.test was getting confused by a 1496behavior difference between toybox and ubuntu (Ubuntu's ln -sf wouldn't 1497replace a symlink that pointed to itself, toybox's would), now there's 1498an explicit rm so it works on ubuntu too. The test suite plumbing's 1499error message for a test with the wrong number of arguments now 1500correctly identifies which test it's complaining about, and it can now 1501run a test on a command name beginning with "-" (none yet but it 1502comes up in toysh).</p> 1503 1504<p><u>Building</u>: You can now override strip with $STRIP. The set of 1505"make install_airlock" commands got tweaked for the 4.17 kernel (which 1506needs bison and flex because the new kconfig plumbing doesn't have _shipped 1507versions of those generated files like the old kconfig did), and for 1508the new release (remove ping, toybox provides it now). 1509$LDFLAGS now applies to library probing (the android NDK provides 1510dynamic libraries without corresponding --static versions). 1511Elliott took a CFG_TOYBOX_DEBUG check out of an error_exit() to make 1512clang stop complaining about an error that should never happen.</p> 1513 1514<a name="24-02-2018" /><a href="#24-02-2018"><hr><h2><b>February 24, 2018</b></h2></a> 1515<blockquote><p> 1516"Arthur," said Ford.<br /> 1517"Hello? Yes?" said Arthur.<br /> 1518"Just believe everything I tell you, and it will all be very, very simple."<br /> 1519"Ah, well, I'm not sure I believe that."<br /> 1520</p> 1521<p> - The Hitchhiker's Guide to the Galaxy</p> 1522</blockquote> 1523 1524<p><a href=downloads/toybox-0.7.6.tar.gz>Toybox 0.7.6</a> 1525(<a href=https://github.com/landley/toybox/releases/tag/0.7.6>git commit</a>) 1526is out, a month and change late.</p> 1527 1528<p>This release adds a <b>crc32</b> command and 1529cleans up and promotes <b>iconv</b>, <b>logger</b>, and <b>setfattr</b>. 1530Pending added <b>stty</b> and <b>fmt</b>, the other half of <b>ping</b>, 1531and got a lot of cleanup on <b>gzip</b>/<b>gunzip</b>/<b>zcat</b>.</p> 1532 1533<p>The <b>cut</b> command got a complete rewrite adding support for multiple 1534ranges, utf8/unicode characters, and new -CDFO options. Use -C to measure 1535columns rather than characters (for double width chars), and "cut -DF 3-5" 1536selects words (like "awk '{print $3 $4 $5}'").</p> 1537 1538<p>This release adds <b>top -m</b> and <b>iotop -H</b> (and fixed top width truncating for narrow terminal windows), 1539added <b>iconv -c</b>, fixed <b>ps -T 1234</b> to show threads belonging to 1540that PID, improved <b>file</b>'s executable identification (properly recognizing 1541both endiannesses and adding sh/frv fdpic, bpf, and new microblaze 1542identifiers), and <b>blkid</b> now only shows LABEL= when it isn't blank.</p> 1543 1544<p>Running ./configure now does "make defconfig", help_exit() now shows the 1545"See %s --help" message on the same line, and several web pages 1546(about, code, roadmap, cleanup) got updates.</p> 1547 1548<p>Elliott and the Android devs added <b>df -i</b>, <b>uptime -p</b>, 1549<b>time -v</b>, and <b>xxd -i -ri</b>, 1550fixed <b>id -G</b> to only output the group IDs, fixed the <b>xargs -0 -n</b> 1551combination, made <b>find -exec +</b> obey ARG_MAX (just like xargs), made 1552<b>killall</b> kill scripts too, fixed an off by one error in <b>pidof</b> 1553that could cause false positive matches in 15 character names, added 1554gzip/gunzip/zcat tests, and taught <b>file</b> to identify more stuff 1555(ogg, TrueType font, LLVM bitcode, PEM certs, and PE executables), and 1556for some reason needed TOYBOX_VENDOR in the version stuff. 1557Android <b>getprop</b>/<b>setprop</b> now allows ro. properties to have 1558arbitrary lengths, <b>losetup</b> can now find loop devices under /dev/block (where android puts 1559them for historical reasons), and Andreas Gampe pointed out a thinko in 1560<b>top</b> that triggered llvm's address sanitizer checks.</p> 1561 1562<p>Gael PORTAY asked for mdev to work when Linux has the 1563block layer configured out, Patrick Oppenlander pointed out a problem 1564with make bloatcheck's build dependencies, and 1565xuphung on github fixed config2help building on MacOS X.</p> 1566 1567<p>Commands with locale support now setlocale(LC_TYPE, "C.UTF-8") for more 1568targeted locale support (enable character parsing with 1569utf8 support, use "C" semantics otherwise). The toys/example/test_*.c 1570commands got renamed demo_*.c.</p> 1571 1572<p>In lib.c the millitime() function returns current unix time in milliseconds 1573(which as a 64 bit number is good for + or - 292 million years from 1574midnight Jan 1 1970), and the old xgetty() function became tty_fd() returning 1575-1 instead of erroring out.</p> 1576 1577<p>The "make help" text moved from the Makefile to scripts/help.txt, 1578ls.c now lists some of its deviations from posix, and work is underway 1579to make ps.c more intelligible (and figure out how to break it up into 1580multiple files).</p> 1581 1582<a name="12-10-2017" /><a href="#12-10-2017"><hr><h2><b>October 12, 2017</b></h2></a> 1583<blockquote><p>Would it save you a lot of time if I just gave up and went 1584mad now?</p> 1585<p> - The Hitchhiker's Guide to the Galaxy</p> 1586</blockquote> 1587 1588<p><a href=downloads/toybox-0.7.5.tar.gz>Toybox 0.7.5</a> 1589(<a href=https://github.com/landley/toybox/releases/tag/0.7.5>git commit</a>) 1590is out.</p> 1591 1592<p>This is another <b>mostly bugfix release</b>. I delayed it a bit trying to get some 1593of the many half-finished projects (dd, ping, lsof, iconv, cut, sysconf, 1594the cp --parents option...) finished/promoted/tested, but decided adding big 1595things at the end of the dev cycle would be too destabilizing.</p> 1596 1597<p>A couple <b>new features</b> slipped in anyway. Ilya Kuzmich added head -c 1598and strings -t (and corrected strings' output in a couple places). Elliott 1599Hughes taught file to recognize Macintosh (Mach-O) binaries.</p> 1600 1601<p><b>NOTE</b>: the chrt command is broken when built against musl-libc 1602because that project's maintainer decided he didn't like the system calls 1603it depends on, so he 1604<a href=https://git.musl-libc.org/cgit/musl/commit/?id=1e21e78bf7a5>removed 1605them from his libc</a>. The prebuilt binaries are built against musl, 1606so the chrt command there will always say -ENOSYS. (It works fine built against 1607glibc, and presumably bionic or uClibc.)</p> 1608 1609<p><b>Bugfixes</b>: Remounting (mount -o remount,rw) should work properly now, 1610and we fixed another place ps was segfaulting when /proc 1611entries vanished out from under us (a hard to hit race condition 1612mostly noticeable in long-running "top" exiting; error value was treated 1613as a pointer). Elliott Hughes fixed a -Wformat warning in expr.c, 1614and made xargs split the command 1615line at ARG_MAX (which is 1/4 the stack size ulimit, which normal users 1616can arbitrarily increase but execve() will complain if they don't). 1617Josh Gao made netcat -l exit after handling a request, and reported a 1618seq bug (seq "1000000 10000001" output 1e+06, fixed now). Zach Riggle fixed a 1619broken URL in the README. Rob fixed env -0 checking the flag wrong so 1620it didn't work in combination with other flags (typo).</p> 1621 1622<p><b>Plumbing</b>: 1623Replaced mbrtowc() with a new utf8towc() that doesn't have a context 1624struct or care about locale. A bugfix in comma_scan() (wasn't removing an entry at the end 1625of the list) is why remount _sometimes_ worked (depending on argument 1626order), xgetaddrinfo() is now separate from xconnect(), 1627atolx_range() learned the w (word=2) suffix, and b is now (block=512) instead 1628of (byte=1).</p> 1629 1630<p><b>Build</b>: Patrick Oppenlander added a workaround for a bug in config2help.c 1631that resulted in segfaults on newer toolchains. (It was actually a use 1632after free error; the build infrastructure isn't nearly as heavily audited as 1633code that gets installed on the target; oops.) A new GITHASH 1634environment variable can force the build version from 1635the command line, and the build checks for .git in the top directory 1636before asking git what our version is (so it isn't confused by ../../.git 1637in an enclosing directory). Added a build #warning about musl intentionally 1638breaking chrt (as with nommu fork() musl now provides a broken 1639stub function so compile-time probes for its existence think it's there, and 1640you can't run the result to test behavior when cross compiling).</p> 1641 1642<a name="19-06-2017" /><a href="#19-06-2017"><hr><h2><b>June 19, 2017</b></h2></a> 1643<blockquote><p>It is a well-known fact that those people who most want to rule people are, ipso facto, those least suited to do it. 1644To summarize the summary: anyone who is capable of getting themselves made President should on no account be allowed to do the job.</p> 1645<p>- The Hitchhiker's Guide to the Galaxy</p> 1646</blockquote> 1647 1648<p><a href=downloads/toybox-0.7.4.tar.gz>Toybox 0.7.4</a> 1649(<a href=https://github.com/landley/toybox/releases/tag/0.7.4>git commit</a>) 1650is out. No new commands this time, but 1651<b>chrt</b> and <b>dmesg</b> got promoted out of pending.</p> 1652 1653<p><u>New features</u>: 1654Rob rewrote paste, which should work much better now, and added grep 1655-M and -S to match and skip wildcards respectively (useful with -r). 1656Elliott's updated dmesg has -T and --color. The file 1657command can recognize gzip now, uptime grew -s, date grew %N, env knows - as a first argument 1658means -i (posix!) and grew -0, ls defaults to -b 1659instead of -q now when there's a tty, and ls has a new -ll option (with 1660--full-time as a compatibility synonym) showing nanoseconds and (for some 1661reason) timezone. (Why do individual files have timezones?) Elliott added 1662"uudecode -o -" support. Illya Kuzmich taught head -v and -q. The cpio 1663code no longer adds the "TRAILER!!!" entry by default (initramfs extractor 1664doesn't care) without which you can concatenate cpio archives with "cat". 1665(Use the new --trailer option if you want the legacy behavior.) 1666In pending, fdisk compiles now and tar understands bzip2.</p> 1667 1668<p><u>Build</u>: 1669The "make install_airlock" target now symlinks bc from the host because 1670the kernel <a href=https://landley.net/notes-2013.html#28-03-2013>inexplicably</a> 1671needs that to build. This was motivated by 1672<a href=https://github.com/landley/mkroot>mkroot</a>, which builds under 1673a toybox airlock directory.</p> 1674 1675<p>Lots of work on the test suite, mostly from the Android guys who are now 1676running it under Android. This fixed several existing tests that didn't 1677pass, made more tests run on a toybox-only system, and so on. The test suite 1678infrastructure now has a second testing function, 1679"testcmd", which supplies the command name being tested (bypassing 1680shell builtins).</p> 1681 1682<p>Various android build and config fixes, getting closer to being able 1683to let android someday use scripts/make.sh instead of generated/* snapshots. 1684Also more work into building under android's NDK; not quite there yet 1685but much closer. 1686Use nproc in scripts/make.sh detect available processors (so you can control the SMP level with taskset). 1687Removed the old uClibc compatibility glue, it's been 5 years since their 1688<a href=http://lists.busybox.net/pipermail/buildroot/2016-December/180102.html>last release</a>.</p> 1689 1690<p>The new config option TOYBOX_PEDANTIC_ARGS checks arguments when there 1691are no arguments, so things like "uptime" no longer silently ignore arguments 1692you pass but instead refuse to run.</p> 1693 1694<p><u>Docs</u>: 1695The FAQ now has more than one entry. Commands no longer output the full 1696help text for argument errors but instead just say "See %s --help" with the 1697command name (in addition to the actual error message). 1698Elliott did a big period-ectomy on all the --help text, and 1699we cleaned up some tab/space inconsistency. The 1700non-html help -a output now has separators with the command name. 1701The top/iotop and pkill/pgrep help text now describe a lot more of what 1702the commands can do. Twitter's code of conduct page went down so we 1703mirrored the text locally.</p> 1704 1705<p><u>Bugfixes</u>: 1706Fixed a race condition in ps/top where a process that exited right as we 1707read its data returned a different error value than we were expecting (which 1708was causing long-running top instances to occasionally exit), 1709mount now gives an error if it can't autodetect the filesystem 1710type, ps no longer queries the terminal size when output isn't to a tty 1711(so "ps -A | cat" doesn't vary), date's chkmktime() was replaced with 1712simple range checks for fields (to avoid false positives from things like 1713timezones and daylight savings time), removed %s from date's help (we 1714didn't implement it, we have @seconds[.nanoseconds] instead), fixed 1715zcat's buffer flush logic (which was always failing on files larger 1716than 32k), and factor now detects requests for numbers >64 bits and fails 1717loudly instead of producing incorrect answers. 1718Elliott fixed touch -a/-m (they were backwards), and allowed ':' in 1719setprop's property names. Grep now exits with 2 for errors (so -q can 1720distinguish "didn't find" from "didn't work"), doesn't stop on symlinks 1721that point nowhere (there was an error_exit() that should just be a warning), 1722and provides error messages for files we could open but not read.</p> 1723 1724<p><u>Library</u>: 1725New library functions: strend() complements strstart(), minof()/maxof() 1726are min/max macros that evalute arguments once and autodetect type (why 1727isn't this in libc?), xmmap() checks MAP_FAILED (which is not NULL).</p> 1728 1729<a name="21-02-2017" /><a href="#21-02-2017"><hr><h2><b>February 21, 2017</b></h2></a> 1730<blockquote><p>Only six people in the Galaxy knew that the job of the 1731Galactic President was not to wield power but to attract attention 1732away from it. Zaphod Beeblebrox was amazingly good at his job.</p> 1733<p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 1734 1735<p>Despite everything, <a href=downloads/toybox-0.7.3.tar.gz>Toybox 0.7.3</a> 1736(<a href=https://github.com/landley/toybox/releases/tag/0.7.3>git commit</a>) 1737is out. The <u>new commands</u> this time are <b>ftpget</b>, <b>ftpput</b>, <b>microcom</b>, and <b>ascii</b>.<p> 1738 1739<p>We also had two command _demotions_ out of defconfig: 1740<b>hostid</b> got moved to toys/example and 1741switched to "default n" because despite <a href=http://pubs.opengroup.org/onlinepubs/9699919799/functions/gethostid.html>still being in posix</a> 1742the concept of a unique 32 bit number identifying a system is something 1743Linux outgrew about the time Pauline Middelink wrote the first IP 1744Masquerading code. And Elliott did a complete rewrite of <b>dmesg</b> introducing 1745two codepaths that I didn't get a chance to unify and didn't want to 1746hold up the release for, so that's back in pending.</p> 1747 1748<p><u>New features</u>: Rob added units to <b>find</b> -atime and friends 1749(with the legacy -amin alias). Elliott added color and -w to dmesg, fallocate 1750-o, and improved file's ELF parsing. Steve Muckle added -d and finit_module 1751support to modprobe. Rob and Elliott tweaked the 1752ps/top display format a bit more (extending the USER field from 8 to 18 chars 1753and putting + at the end of string fields that got truncated). 1754df -a isn't entirely new, but wasn't documented and needed a bugfix.</p> 1755 1756<p><u>Bugfixes</u>: 1757Last release broke oneit because -c didn't get moved to xopen_stdio() (oops). 1758Rob and Elliott simultaneously spotted ps padding each line to 99999 1759chars when there's no tty (serial console or adb); now it pads to 80 in 1760that case but also switches on -w to avoid field truncation. The "tty" 1761field also sometimes had trailing debris (that's fixed now). And "top" was 1762endlessly redrawing with out tty because receipt of the ANSI size probe 1763results would set SIGWINCH, and handling that sent another ansi probe. (Sigh.) 1764And while we're there, replace "ADDR" with "BIT" in ps -l so there are 1765more than 4 chars left for the "CMD" field on 64 bit systems.</p> 1766 1767<p>Izabera pointed out that split -b and -l can't mix, and suggested seq should 1768multiply to avoid accumulating rounding errors from repeated fractional 1769increments. Wang Xiao Jian fixed a bug in sort -k. 1770Elliott let getprop use the @ character in property names, and 1771Dimitry Ivanov removed the name length limit for system properties. 1772Elliott also improved some error reporting and improved top -H's display 1773of thread names. 1774 1775<p>Josh Gao pointed out that recursive operations on . and .. could be ignored 1776in chmod -R (and the resulting generic fix to dirtree_notdotdot() fixed 1777it in several other places).</p> 1778 1779<p>Justin Cormack caught tar producing a warning to stdout that screwed up 1780"tar c" to stdout. 1781Rob fixed an option parsing bug (where switching off a --longopt in menuconfig 1782confused the parser), and another one where an option excluding itself 1783(ala "abc[-ab][!abc]" with "command -a -b") would segfault.</p> 1784 1785<p>There's some sort of gcc stack over-optimization bug where musl-libc's 1786version of vfork() doesn't get marked with attribute(returns_twice) so 1787stack varabiles in the same function after that get semi-randomly overwritten 1788when the optimizer decides to reclaim the space. So add the attribute 1789to the function the XVFORK() wrapper macro calls. (It's a nommu thing.)</p> 1790 1791<p>Fixed a couple variable size mismatch bugs that were only tested on 64 bit 1792(printf %x 64) or only tested on 32 bit (modprobe), removed some 1793unnecessary casts in stat.</p> 1794 1795<p>Continuing attempts to build under Android NDK brought up that posix 1796defines the global 'stdout' as a macro, which older versions of bionic 1797turned into an array member, but a function was using it as an argument 1798name. (This worked in the AOSP build because it only builds against current 1799bionic, where there's a global 'stdout'.)</p> 1800 1801<p>Several commits argued with clang's warning generation, eventually 1802settling on a variant of __attribute__((__shut_up__)).</p> 1803 1804<p>Android should no longer give spurious error messages 1805when you "ps -A | head" about EPIPE on output. (Older versions of bionic 1806set an error handler on SIGPIPE, but it shouldn't do that now. More recent 1807versions of adb set the SIGPIPE handler to SIGIGN instead of SIGDFL, 1808leading to write returning an error message instead of silently killing 1809the program. So we set it back to the default.)</p> 1810 1811<p><u>Docs</u>: 1812Removed website link to the gmane archive (which didn't survive gmane's 1813change of ownership). The FAQ now answers a _second_ question. (Woo!) 1814Some roadmap updates.</p> 1815 1816<p><u>Build tweaks</u>: 1817Upgraded "make install_airlock" target to only warn about missing 1818commands (unless $PEDANTIC is set) when it sets up the hermetic build 1819path. (The plan is still to implement everything but the toolchain 1820binaries in toybox, but in the meantime we're symlinking other stuff from 1821the $HOST that isn't ready yet. See 1822<a href=https://github.com/landley/mkroot>mkroot</a> for an example using 1823this.)</p> 1824 1825<p>Elliott and Rob continue to poke at building toybox with Android's NDK, 1826but it's a work in progress (<a href=http://lists.landley.net/pipermail/toybox-landley.net/2016-December/008767.html>thread</a>). Various changes 1827removing libcutils dependencies and adding an selinux dependency to getprop 1828are fallout from this.</p> 1829 1830<p>Cross-compiling from Macs needs to use "gsed" instead of apple's 1831version, so teach the build to use that name if it exists in the $PATH. 1832If you try to build without running config first, you should get better 1833error reporting now. Added a workaround for Centos' broken "which" command 1834producing output when it _can't_ find a name in the $PATH.</p> 1835 1836<p><u>Library</u>: 1837The new dirtree flag DIRTREE_PROC skips non-numeric entries so things 1838like ps and top can scan /proc more efficiently.</p> 1839 1840<a name="21-10-2016" /><a href="#21-10-2016"><hr><h2><b>October 21, 2016</b></h2></a> 1841<blockquote><p>Probability factor of one to one. We have normality. I repeat, 1842we have normality. Anything you still can't cope with is therefore your 1843own problem.</p><p> - The Hitchhiker's Guide to the Galaxy</p></blockquote> 1844 1845<p><a href=downloads/toybox-0.7.2.tar.gz>Toybox 0.7.2</a> 1846(<a href=https://github.com/landley/toybox/releases/tag/0.7.2>git commit</a>) 1847is out.</p> 1848 1849<p>During this development cycle, Elliott Hughes <a href=http://androidbackstage.blogspot.com/2016/07/episode-53-adb-on-adb.html>got interviewed 1850on the ADB podcast</a> 1851and Rob Landley <a href=http://linuxluddites.com/shows/episode-88/>got interviewed on Linux Luddites</a> (<a href=http://linuxluddites.com/shows/episode-11/>again</a>). 1852Both talk about toybox and many other things. 1853The web page also grew a new <a href=faq.html>FAQ page</a>, currently with 1854just the one.</p> 1855 1856<p>New comands added to defconfig are <b>tunctl</b>, 1857<b>log</b>, <b>start</b>, <b>stop</b>, and <b>sendevent</b>. 1858The commands <b>file</b> and <b>netstat</b> got promoted out of pending. 1859Pending added <b>chrt</b>, <b>setfattr</b>, and <b>getfattr</b>, and saw 1860a lot of cleanups to diffstat and dd but not enough to promote them to 1861defconfig yet. A new toys/net directory was added, moving ifconfig, netcat, 1862netstat, rfkill, and tunctl there so far.</p> 1863 1864<p><b>Upgrades</b>: All commands now parse --version when they understand 1865--help, but "true" and "false" should now ignore their arguments entirely. 1866We taught stat to handle "%12x" and "%.12x" printf-style escapes, which 1867apparently other versions do. The ifconfig output now shows the interface's 1868device driver. Added patch -d and --dry-run, wc can now do -cm together, 1869find has a NOP -noleaf so scripts that use that don't break, add -c to md5sum 1870and sha1sum. Elliott taught ps to treat extra aguments as additional -p 1871pids, implemented xxd -s, did a number of upgrades to file (added -HL, 1872support for ar files, improved ELF support to report android API level 1873and stripped/not stripped and it no longer prints a guessed build ID type). 1874Elliott also added optional build-time support for using openssl's 1875assembly-optimized md5sum/sha1sum implementations (leading to a new 1876<a href=design.html>design</a> policy on shared libraries).</p> 1877 1878<p><b>Bugfixes</b>: Too many fixes to "ps" and "touch" to list, from both 1879Elliott and Rob. Rob taught sed to handle s/[[:space:]/]// type sequences 1880properly, switched grep to a better 1881workaround for <a href=https://sourceware.org/bugzilla/show_bug.cgi?id=17829>glibc bug 17829</a>, made sed -i preserve ownership when run as root, 1882made du max out at 2 terabytes instead of 2 gigabytes on 32-bit systems 1883(it was always designed to, but was missing a typecast), 1884fixed the option parsing infrastructure (config options that remove command 1885line options got the placeholders wrong), fix to printf for printing 1886octal digits and handling the (posix-mandated) difference between %b and 1887non-%b octal output, reading from "-" no longer closes stdin when done, 1888netcat -L works with nommu (although it may need more portability work), 1889and you can now "make test_scankey" if you want to. Several commands 1890(stat, makedeves, chgrp, cp, find) handled user name lookup failure badly 1891(stat was segfaulting if you interrogated a file belonging to a nonexistent 1892user, "chown 12345 file" errored out if you didn't have that user 1893in /etc/passwd... now they should all print/accept the number when 1894appropriate). "LC_ALL=C ls -Cs --color" produces the same output 1895as other versions (two spaces padding, -k hardwired on).<p> 1896 1897<p>Kyungsik Lee fixed a bug 1898in cp (readlink() doesn't actually null terminate the string it reads in), 1899Elliott Hughes made pgrep/pkill return success/failure, fixed trailing 1900whitespace in netstat, fixed a SMACK symbol conflict due to linux/xattr.h 1901changing, fixed ls -sh, and added a lot of 1902stuff to the <a href=roadmap.html>roadmap page</a>. 1903Izabera pointed out cmp -l and -s can't be selected at the same time, 1904that timeout was never actually checking -v, that ls should default to -q 1905when output is to a tty, and that "file -" would sometimes try to open "-" 1906instead of stdin. 1907Usischev Yury pointed out a use after free error, and that id shouldn't 1908call exit() directly. Matthias Urhahn pointed out that stat(2) returns 1909hardwired 512-byte units, so stat.c was wrong. David Hedges pointed out 1910that route could only handle 10 character interface names when the kernel 1911can do 15 (it's still in pending for a reason, but fixed). Evgenii 1912Stepanov found and helped diagnose one of the more subtle ps bugs fixed 1913this time around.</p> 1914 1915<p>Calling "make test_blah" no longer causes make to error out if the last 1916test fails (and thus returns a nonzero error code). 1917Building single commands and the multiplexer used to require a "make clean" 1918between them (because they had different config files both of which were older 1919than generated/config.h so it didn't get rebuilt; now it just always 1920rebuilds it).</p> 1921 1922<p>The defconfig build is now slightly less broken on older centos versions 1923(although <a href=http://lists.landley.net/pipermail/toybox-landley.net/2016-September/008664.html>the consensus</a> is that Centos is just generally broken).<p> 1924 1925<p>Several commands were over-using xprintf(), which flushes its output 1926to check for error (something you only need to do maybe once per line, 1927and even then maybe only in loops because xexit() flushes and checks 1928ferror() for you and adjusts the exit code if we wrote stuff to stdout 1929that couldn't be printed). Lots of little flushes are inefficient, 1930so most things can use normal printf(). (Retransmission 1931of short writes is presumably libc's problem since it's buffering the 1932output and all.)</p> 1933 1934<p><b>Library:</b> 1935New library functions readlink0() and readlinkat0() which properly null 1936terminates the symlink value (which the stock libc function inexplicably 1937doesn't). 1938The new do_lines() function interates reading lines from a filehandle 1939and calling a function on each line. 1940New function pollinate() factoring out netcat's poll() loop so things 1941like telnet can use it. 1942New functions getusername() and getgroupname() return a 1943char * given a uid/gid (and return a string representation of the number 1944if the lookup fails), and xgetpwnamid/xgetgrnamid were renamed to 1945xgetuid/xgetgid and now return an integer instead of a struct (also helping 1946handle lookup failures, you can still return the uid/get for "12345").</p> 1947 1948<p>Switched atolx() to use long long internally. 1949Renamed xopen() to xopen_stdio() and made a new xopen() that never returns 1950stdin, stdout, or stderr (duping /dev/null into the filehandles as necessary). 1951New function xopenro() opens a file read only with one less argument, and 1952understands that "-" means stdin. New flag WARN_ONLY tells these functions 1953to just print a warning on failure, and return -1 instead of exiting. 1954Misc new functions like openro() which defaults to the WARN_ONLY behavior 1955and notstdio() which dup()s a filehandle up beyond stdin/out/err backfilling 1956with /dev/null as necessary. The WARN_ONLY flag let us remove the failok 1957argument from loopfiles().</p> 1958 1959<p>New TOYFLAG_NOHELP disables --help processing (which "true" and "false" 1960should not do).</b> 1961 1962<p>The test suite now has NOSPACE=1 to ignore whitespace (using diff -b to 1963check results), which helps TEST_HOST pass the same tests as toybox. 1964Fixes to chattr and date tests. It also has a new variable $C with the 1965absolute path to the command being tested (bypassing shell builtins), 1966and a function testcmd() which is just like testing() except it prepends 1967the command name ($C) to the test command line as well as the test 1968description.</p> 1969 1970<a name="02-06-2016" /><a href="#02-06-2016"><hr><h2><b>June 2, 2016</b></h2></a> 1971<blockquote><p>When the 'Drink' button is pressed it makes an instant but 1972highly detailed examination of the subject's taste buds, a spectroscopic 1973analysis of the subject's metabolism, and then sends tiny experimental 1974signals down the neural pathways to the taste centres of the subject's 1975brain to see what is likely to be well received. However, no-one knows 1976quite why it does this because it then invariably delivers a cupful of 1977liquid that is almost, but not quite, entirely unlike tea.</p> 1978<p> - The Hitchhiker's Guide to the Galaxy</p></blockquote> 1979 1980<p><a href=downloads/toybox-0.7.1.tar.gz>Toybox 0.7.1</a> 1981(<a href=https://github.com/landley/toybox/releases/tag/0.7.1>git commit</a>) 1982is out. (Yes, I forgot to update the --version string, but I already 1983uploaded the <a href=downloads/binaries/0.7.1>binaries</a>.)</p> 1984 1985<p>The website has https support now, you can "make cat ps ls" 1986to get standalone commands (and "make list list_pending" to see what's 1987available), and a whole lot of bugfixes and new options to existing 1988commands.</p> 1989 1990<h2>New Commands</h2> 1991<p>Rob implemented <b>ulimit</b>. In pending, Elliott Hughes implemented 1992file. and Lipi Lee implemented a simple wget. (Pending also had minor 1993cleanups to more and lsof, but no promotions this time around.)</p> 1994 1995<h2>New Options</h2> 1996<p>Izabera implemented env -u, suggested adding seq -w, made factor 1997use full unsigned 64 bit math even on 32 bit platforms, pointed out base64 1998-w0 should disable wrapping, and sped up wc -c. 1999Elliott Hughes added mount -o relatime, xxd -p -r, and od -w. 2000Sameer Pradhan (or possibly Bilal Qureshi) suggested adding stat -tL -c %m%t%T.
2001Tom Cherry added getprop -Z. Paul Barker added hostname -b and -F. 2002Rob added ls -b, made ls -q work with utf8, 2003made sed -f - read from stdin, and added top -O (like ps -O).</p> 2004 2005<p>Elliott and Rob <b>added Thread support to ps and top</b>, 2006with -o TID, TNAME. We also added -o PCY (android scheduling policy), 2007-o BIT (process is 32 or 64 bit), and -o TNAME now shows the parent 2008command name for threads.</p> 2009 2010<h2>Documentation</h2> 2011 2012<p>Rob added the sed invocations to convert tabs/spaces and back to 2013design.html. Isaac Dunham updated hexedit's help text. 2014Jakob Flierl pointed out a broken URL in the README.</p> 2015 2016<p>Rob also redid the naming scheme of sed's pattern manipulation code to 2017remove the gratuitous references to Roger Zelazny's "Amber" series, since it 2018was confusing people.</p> 2019 2020<h2>Bugfixes</h2> 2021 2022<p>Grep -H and -n should now work properly with -ABC. Andy Chu pointed out an 2023out of bounds access for zero length lines in rev, fixed a buffer overflow 2024in diff -r, and fixed operator precedence in expr (although Rob is rewriting 2025chunks of expr so toysh can use its plumbing for $(( )) ). 2026Patrick Ohly fixed the too-aggressive suid permission dropping logic. 2027Josh Gao fixed a segfault when find -iname got no argument, and 2028made tail -f work right with just one file argument. 2029Tom Marshall cleaned up tar's long filename support and improved 2030the tar tests, and reported another find bug (with -iname -o -iname not 2031tracking copy lifetimes properly) that got fixed.</p> 2032 2033<p>Elliott Hughes fixed wc -c to not trust zero length files to actually be 2034zero length (/proc does that), fixed "mount -o rw,remount /system" on 2035Android, removed trailing spaces on ps -o cmdline, fixed pkill -9 and 2036the corresponding tests, made "insmod -" work, fixed top -b and tail -NUM, 2037pointed out that ps shouldn't trim numeric fields for display size limits, 2038and added some more 2039explicit "sort" calls to make pipelines so build tempfiles are easier to cache. 2040Rob <a href=https://github.com/landley/toybox/commit/32b3587af261>fixed an insane sed thing</a> the perl 5.22 build was doing. 2041Fixed mount -o to properly pass in leftover string data, and 2042<a href=http://lists.landley.net/pipermail/toybox-landley.net/2016-March/004790.html>documented how to use toybox to mount nfs</a> (warning: kernel patch 2043to fix some bitrot in the kernel NFS driver's string parsing attached 2044to that message).</p> 2045 2046<p>George Burgess IV corrected some variable types in traceroute. 2047Base64 now wraps == properly. Fixed two bzcat segfaults reported by 2048John Regehr. Andy Chu found a segfault in "sed -e 'c\'" with no trailing 2049line, and implemented mv -n and cp -n. The cyanogenmod guys pointed out that 2050cp -a shouldn't complain if a non-root user can't chown, and we added 2051the output path to cp -r error messages while we were there (before was just 2052the filename).</p> 2053 2054<p>Samuel Holland fixed blkid's handling of vfat labels, and 2055fixed a segfault when basename was passed an empty string and an empty 2056suffix. Davis Mosenkovs fixed touch -t seconds parsing. 2057Rob fixed a bunzip bug reported by John Regehr (the bad CRC 2058error message was printing a NUL argument).</p> 2059 2060<p>Not all of the commands build standalone, but more of them do now; 2061scripts/single.sh can now build a "mv" that isn't actually "cp". 2062The dependencies are more granualr, so "make top; make ps" no longer 2063produces a broken ps that ignores -A (because ps.o wasn't getting rebuilt 2064even though top had the FLAG macros for -A zeroed).</p> 2065 2066<h2>Build</h2> 2067<p>Rob added a <b>warning when building commands out of 2068pending</b>. (The pending directory is full of code that hasn't been 2069properly vetted. Use at your own risk.)</p> 2070 2071<p><b>New build targets let you build individual commands by name</b>, ala 2072"make ls cat ps", and you can run the test suite for each standalone 2073command with "make test_ls" and such. 2074"make list" shows all such standalone commands in defconfig, and 2075"make list_pending" shows unfinished commands from toys/pending 2076("make list list_pending" shows both together). "make clean" now deletes 2077these filenames at the top level, and the corresponding unstripped files 2078live in the directory generated/unstripped.</p> 2079 2080<p>Nicholas Boichat suggested switching make.sh to use $! for process 2081enumeration during parallel builds (which is both more efficient and more 2082portable), and suggested shell builtin replacements for wc/awk/sed so the 2083build loop has fewer forks now.</p> 2084 2085<p>Lots of work on the test suite, much of it due to Andy Chu. It now 2086consistently prints the name of the command being tested at the start of each 2087test (and the common infrastructure does that, not each individual test), and 2088"make tests" actually runs all the available tests now. 2089Seperated pgrep and pkill tests, split lsattr/chattr, added fstype and base64 2090tests. The "tests/files" directory now collects files for tests to 2091use, with blkid, bzcat, and utf8 subdirectories: the $FILES variable 2092gives a path to it, so "$FILES/blkid/ext2.bz2" and so on. 2093The testsuite now has test files with 3 different types of "not utf8 output" 2094sequences that require escaping, plus some combining character torture 2095tests, direction reversals, and so on.</p> 2096 2097<p>Added dependencies on TOYBOX_FORK to various pending commands that need 2098nommu conversion (which should fix the allyesconfig build).</p> 2099 2100<p>Static builds with selinux should work again.</p> 2101 2102<h2>Library</h2> 2103 2104<p>New bufgetgrgid() and bufgetpwuid() functions cache previous lookup info 2105rather than repeatedly traversing /etc/passwd and /etc/group (which is slow). 2106Added xpipe() to lib to catch pipe creation failure. 2107The HELP_ macros generated by config2help.c now use a capital prefix 2108to avoid collicing with help_exit() and such.</p> 2109 2110<p>The dirtree infrastructure got a cleanup pass in preparation for adding 2111infinite recursion depth support (needed by rm -r), updated the 2112<a href=code.html#ib_dirtree>documentation</a> to describe the new 2113semantics (removing dirtree_start() and adding dirtree_flagread()). 2114Now dirtree_recurse() takes the new dirfd as an argument.</p> 2115 2116<p>Split out _xexit() from xexit() and let sigatexit() set multiple 2117callbacks.</p> 2118 2119<p>For years the man pages have said to #include <sys/types.h> to get 2120major/minor/makedev but now that glibc 2121<a href=https://sourceware.org/ml/libc-alpha/2015-11/msg00253.html>has vowed 2122to break existing programs</a> and replace it with another nonstandard header 2123not in posix or lsb, we added our own functions to lib/ to do the transform 2124ourselves (based on what the kernel actually expects).</p> 2125 2126<h2>Portability</h2> 2127 2128<p>Debian unstable started needing an extra header #include for some reason, and 2129although printf("%.*s", INT_MAX, s) worked fine on Ubuntu 12.04 it 2130didn't on 14.04, so added a workaround for that. Typecast a printf because 2131wchar_t isn't a rigidly defined size. RLIMIT_RTTIME was 2132added to the kernel in 2008 but you can't expect uClibc to have noticed yet, 2133nor did it #define MS_RELATIME (added in 2006), or prlimit (2010)... 2134(Given the improvements in musl and bionic, uClibc support may be dropped 2135in a future release.) Given that the xattr functions were added during 2136linux 2.5, we can #include its header unconditionally.</p> 2137 2138<p>Renamed basename_r() to something else to avoid conflicting with freebsd's 2139libc, and both scripts/install.h and scripts/config2help.c no longer include 2140toys.h (to make cross-compiling from systems we don't run on easier).</p> 2141 2142<p>Debian bug 635570 did something unspeakably nonportable, depending on 2143"sed -e 'a\'" (with no next line of the pattern, so an unterminated 2144continuation) to add a newline to the last line of input if and only if 2145that last line of the input didn't have a newline, and to take no other 2146action. This is well into "depending on a bug" territory, but we implemented 2147it because otherwise Debian's install broke. (Of course this behavior 2148is undocumented, non-obvious, and doesn't really make logical sense.)</p> 2149 2150<p>CONFIG_TOYBOX_NORECURSE now disables the stack measuring logic (which 2151was giving some "security" code fits). Also we typecast pointers to (long) 2152before comparing them to avoid spurious compiler "optimizations" that 2153break the code.</p> 2154 2155<a name="02-02-2016" /><a href="#02-02-2016"><hr><h2><b>February 2, 2016</b></h2></a> 2156<blockquote><p>"I checked it very thoroughly," said the computer, "and that 2157quite definitely is the answer. I think the problem, to be quite honest with 2158you, is that you've never actually known what the question is." 2159</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 2160 2161<p><a href=downloads/toybox-0.7.0.tar.gz>Toybox 0.7.0</a> 2162(<a href=https://github.com/landley/toybox/releases/tag/0.7.0>git commit</a>) 2163is out.</p> 2164 2165<p>The new commands in defconfig are <b>iotop</b>, <b>top</b>, <b>pgrep</b>, 2166and <b>pkill</b> 2167(most replacing corresponding versions from pending). Added grep -ABC, 2168swapon -d (discard), mkswap -L (label) and UUID support, and find -delete. 2169Izabera added free -h and unshare -f. Josh Gao implemented tail -f. 2170Jose Bollo submitted cp --preserve=context,attr. Kylie McClain added 2171mktemp -u.</p> 2172 2173<p>In pending there's the start of a vi command, and Sameer Pradhan contributed 2174a new dhcp6. This cycle saw several rounds of route cleanup and a little dhcp 2175cleanup, but neither are complete yet. Lipi Lee did some cleanup to netstat.c 2176and Elliott Hughes removed warnings from traceroute.</p> 2177 2178<p>Lots of updates to ps: several new -o options, -k (--sort) -O and -M, 2179improved compatibility with Android's historical behavior, and 2180extensive internal code cleanup (including the removal of all 2181the magic constants).</p> 2182 2183<h3><b>Website</b></h3> 2184 2185<p>Dreamhost restored the <a href="#12-21-2015">missing 11 months</a> 2186to the mailing list archive, in the process deleting the month after 2187that. Now they've asked if I have mbox files archiving the new 2188gap (between December 20, 2015 to January 21, 2016, and presumably they 2189could also fill in the gap from December 14, 2014 to January 3, 2015 that's 2190been there since the last time they did this), 2191but due to some gmail filtering I've 2192<a href=http://landley.net/notes-2012.html#15-10-2012>never 2193been able to disable</a>, my copy of those files is spread among 3 different 2194mbox files I'd have to sort/filter/collate. (It's on the todo list.)</p> 2195 2196<p>Added a code of conduct to the README (we're 2197<a href=https://engineering.twitter.com/opensource/code-of-conduct>borrowing twitter's</a>) because somebody 2198made it necessary.</p> 2199 2200<h3><b>Bugfixes</b></h3> 2201<p>Fixed another sed bug where any ] right after [ was skipped (not just the 2202first one in the range, so [[] didn't terminate). Fixed sort -f and added test cases. 2203Assume 80 columns in "ls -m | cat", ls -L is no longer backwards, 2204and ls of files with no paths no longer uses an uninitialized (zero) dirfd. 2205Several bugfixes 2206to find (Gilad Arnold fixed -perm, Daniel K. Levy fixed "find . -exec echo {}", 2207and while we're there I fixed find --prune, made "find . -execdir 2208echo {} + -execdir ls {} +" work, and ripped out the environment size 2209measuring code that checked for a 128k limit removed back in linux 2.6.22). 2210Elliott Hughes fixed the date command's parsing of 4 digit 2211years and documented the %s escape, fixed hwclock -u, and pointed out 2212that runcon needs to exec to do its job (not recursively call another 2213command_main() in the same process). Tom Marshall reported that blkid was 2214handling ext2 wrong. Mike Moreton corrected cpio extraction's uid and gid 2215values, and added a --no-preserve-owner option. Fixed the SUID permission 2216dropping logic (which was a bit over-zealous, preventing some commands from 2217running at all).</p> 2218 2219<p>I'm told that debian-testing broke its libc so the nsenter build breaks, 2220but my attempts to install the debian-testing network cd image under 2221qemu keep breaking. Maybe someday they'll fix it enough I can actually 2222reproduce the problem. (Debootstrap under unbuntu builds an ubuntu-flavored 2223chroot in which toybox builds fine.)</p> 2224 2225<h3><b>Documentation</b></h3> 2226<p>Rewrite of the about.html page, tweaks to design.html, and a re-triage of 2227sbase in roadmap.html. Update to mkstatus.py to collate multiple span 2228tags with the same id, resulting in a larger status.html page (which 2229was previously ignoring some commands in the roadmap).</p> 2230 2231<p>Expanded the defconfig/allyesconfig/allnoconfighelp text in "make help" 2232to explain what they're for.</p> 2233 2234<h3><b>infrastructure</b></h3> 2235<ul> 2236<li><p>Expanded toys.optargs to 64 bits so a command can have more than 32 options.</p></li> 2237<li><p>Added NOEXIT() wrapper to turn xwrap() functions into warning versions 2238using the existing longjump(toys.rebound) infrastructure.</p></li> 2239<li><p>Renamed dirtree->data to dirfd and stopped storing symlink length 2240into it (this fixed a bug where following symlinks to directories 2241didn't give a valid directory filehandle, noticeable with ls -Z).</p></li> 2242<li><p>New TAGGED_ARRAY() infrastructure generates index and bitmask macros 2243for arrays of structures starting with a name string.</p></li> 2244<li><p>New lib/linestack.c for utf8 fontmetrics (draw_str() and utf8len() 2245and so on), and for tracking multiple lines of text 2246(vi, less, shell history) that need wordwrapping and scrolling up/down.</p></li> 2247<li><p>Upgrades to lib/interestingtimes.c: scan_key() now has a timeout 2248in milliseconds and recognizes more sequences including ANSI 2249window size probes. New utf8 test files in tests/files/utf8 including 2250sequence reversing, stacked combining chars, and all three types of 2251unprintable sequences (low ascii <32 ala ^X, invalid utf8 sequences ala 2252<AB><CD>, and invalid unicode code points ala U+1234).</p></li> 2253<li><p>More comma handling code in lib.c: comma_args()</p></li> 2254<li><p>Added error_msg_raw() to shut up fortify's endless static checking false 2255positives.</p></li> 2256<li><p>readfileat() can now realloc() in a loop to read long files 2257("zcat | insmod" needed it).</p></li> 2258</ul> 2259 2260<h3><b>Roadmap</b></h3> 2261<p>We're getting close to having a self-hosting development environment 2262using toybox for the command line. The remaining busybox commands in 2263<a href=http://landley.net/aboriginal/about.html>Aboriginal Linux</a> are:</p> 2264 2265<blockquote><p><b> 2266awk bunzip2 bzcat bzip2 dd diff expr fdisk ftpd ftpget ftpput gunzip gzip 2267less ping route sh sha512sum tar test tr unxz vi wget xzcat zcat 2268</b></p></blockquote> 2269 2270<p>And the remaining non-busybox commands in Aboriginal Linux's build/host 2271directory (from the distcc, genext2fs, e2fsprogs, zlib, and squashfs packagesi) 2272are:</p> 2273 2274<blockquote><p><b> 2275mke2fs fsck.ext2 resize2fs distcc genext2fs unsquashfs distccd mksquashfs tune2fs 2276</b></p></blockquote> 2277 2278<p>Squashfs and distcc are probably out of scope for toybox, but mke2fs, 2279fsck.ext2, resize2fs, genext2fs, and tune2fs should all be added to the 2280above "busybox" replacement list.</p> 2281 2282<p>Remind me to include this countdown in future releases. Once they've all 2283been replaced, the next goal is <a href=http://landley.net/aboriginal/about.html#selfhost>building AOSP under itself</a>.</p> 2284 2285<p>See the full <a href=roadmap.html>roadmap</a> and <a href=status.html>status</a> 2286pages for more details.</p> 2287 2288<a name="12-21-2015" /><a href="#12-21-2015"><hr><h2><b>December 21, 2015</b></h2></a> 2289 2290<p>Yes, 11 months have gone missing from the mailing list web archive.</p> 2291 2292<p>Yesterday evening Dreamhost's mailman server went down (timing out trying 2293to connect). I poked them about it, they 2294<a href=https://twitter.com/landley/status/678781271670149121>blamed 2295DNS</a>, I explained that the hang was _after_ the DNS lookup and 2296entered the dig info into the trouble ticket showing the IPs the DNS 2297queries were returning, they reinstalled the server at that IP from what I 2298assume was their most recent backup, and that's how 11 months of messages 2299vanished out of the archive.</p> 2300 2301<p>I've <a href=https://twitter.com/landley/status/679114451975467008>continued to poke them about it</a> but I honestly believe that's the best they 2302can do. <a href=http://landley.net/dreamhost.txt>Last time</a> 2303this sort of thing <a href=http://landley.net/dreamhost2.txt>happened</a> 2304we went back and forth for months, so I added a link to a backup web 2305archive (in the nav bar on the left) that isn't controlled by dreamhost, 2306and thus doesn't gratuitously lose data on a regular basis. (I note 2307the earlier hole in Dreamhost's archive was never fixed either. That 2308was data never getting archived, this is a year's worth of data that 2309was in the archive until yesterday vanishing after the fact.)</p> 2310 2311<p>If you're wondering why the <a href=http://lists.landley.net>top level</a> 2312list page has been "temporarily disabled" for multiple years now... you'd have 2313to ask Dreamhost. I know I have. More than a dozen times.</p> 2314 2315<a name="03-11-2015" /><a href="#03-11-2015"><hr><h2><b>November 3, 2015</b></h2></a> 2316<blockquote><p>"Alright," said Ford. "How would you react if I said that I'm 2317not from Guildford after all, but from a small planet somewhere in the vicinity 2318of Betelgeuse?" Arthur shrugged in a so-so sort of way. "I don't know," he 2319said, taking a pull of beer. "Why - do you think it's the sort of thing you're 2320likely to say?"</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 2321 2322<p><a href=downloads/toybox-0.6.1.tar.gz>Toybox 0.6.1</a> 2323(<a href=https://github.com/landley/toybox/releases/tag/0.6.1>git commit</a>) 2324is out.</p> 2325 2326<p>We have a new <b>ps</b> command with all the -o fields posix wants (although 2327it doesn't accept BSD non-dash option syntax yet), and <b>bunzip2</b> (not just 2328bzcat but the proper extract-in-place command). 2329Sameer Pradhan added <b>hostid</b> and <b>fsync</b>. 2330Elliott Hughes added <b>flock</b>. 2331 2332<p>The people waiting for <b>human readable number support</b> (du -hH, ls -h, 2333and so on) can thank Elliott Hughes for implementing it. (Our output doesn't 2334exactly match others' because we our "binary" mode will say 1.0G instead of 23351024M, which is a bug in the other one we didn't emulate.)</p> 2336 2337<p>The other big news is <b>nommu support</b>, tested on the new 2338<a href=http://nommu.org/jcore>jcore</a> processor but presumaby working 2339on any nommu system. A few commands don't support nommu yet, but those 2340are disabled by dependencies on TOYBOX_FORK in menuconfig when building 2341for nommu. The roadmap now has a large section analyzing the uClinux 2342project (note that <a href=http://nommu.org>nommu.org</a> is slowly replacing 2343<a href=http://uclinux.org>uclinux.org</a> as the standard repository of 2344all knowledge and wisdom about nommu. The old site <a href=#12-02-2012>contains 2345much that is apocryphal</a>, or at least wildly inaccurate, and the new one 2346is trying to improve on that).</p> 2347 2348<p>Both "make change" and scripts/single.sh (for building standalone commands 2349without the multiplexer logic) now use the top level .config 2350for toybox global settings such as Linux Security Blanket Module selection, 2351(so make defconfig before change now).</p> 2352 2353<p>Documentation updates to the <a href=code.html>code</a> and 2354<a href=roadmap.html>roadmap</a> pages.</p> 2355 2356<h3>pending</h3> 2357 2358<p>In the pending directory Sameer Pradhan added tftp, 2359and Elliott Hughes sent lsof. Isaac Dunham upgraded mdev, 2360reboot, init, login, and modprobe, and fixed a distro-specific build break in 2361scripts/mkflags.h. Elliott Hughes and Lipi Lee made netstat -p handle 2362command lines longer than 21 characters, and Elliott fixed netstat -e and 2363some build warnings. Yeongdeok Suh fixed a warning in dhcpd. 2364I started cleanup on pgrep/pkill.</p> 2365 2366<h3>Command updates, bugfixes, and infrastructure</h3> 2367 2368<p>The multiplexer's "command not found" error exit is now 127, so now you can't 2369distinguish between a command not being found in the multiplexer and 2370the multiplexer itself not being found by the shell, because people wanted 2371that for some reason.</p> 2372 2373<p>Elliott Hughes made date reject invalid dates rather 2374than set the clock to something weird (setting the clock 100 years into the 2375future makes most Linux desktops surprisingly unhappy, and ntpdate won't fix it 2376either), fixed several ls -l display issues (user/group field ordering, 2377make user/group/lsmcontext left aligned), did the aforementioned 2378extensive work on human readable number output, fixed ionice's default 2379class, fixed a mv overwrite bug, made df's columns auto-size, added 2380--ppid and -Z to ps, and teamed up with Daniel K. Levy to fix 2381a segfault in find's handling of -newer -group or -user.</p> 2382 2383<p>Hyejin Kim added stat -c %T support. Colin Cross worked 2384on vmstat fixing 2385a header printing bug and calculating the bi and bo columns in the right 2386units. Isabella Parakiss reported that sed -e "/x/c\" -e "y" added an extra 2387newline and that grep -w '\(x\)\1' didn't work, both now fixed. 2388Alistair Strachan fixed several problems with switch_root. Kylie McClain 2389pointed out env should be able to clear variables via NAME= syntax. 2390Dima Krasner added support for running blkid without a partition (so it shows 2391all partitions). Hyejin Kim sent in a bunch of static analysis bug reports.</p> 2392 2393<p>Isabella Parakiss reported that sed -e "/x/c\" -e "y" added an extra 2394newline and that grep -w '\(x\)\1' didn't work, both now fixed. 2395Alistair Strachan fixed several problems with switch_root. Kylie McClain 2396pointed out env should be able to clear variables via NAME= syntax. 2397Dima Krasner added support for running blkid without a partition (so it shows 2398all partitions). Hyejin Kim sent in a bunch of static analysis bug reports.</p> 2399 2400<p>Two large thinko fixes in oneit: -3 was always enabled (which would 2401eventually block if the child never read the exiting PID numbers from its file 2402descriptor #3 until the pipe filled up), and the signal handlers weren't 2403set up right (for requesting semi-graceful halt/poweroff/reboot). 2404Calling install without a mode is now 0755, and install -g 0 no longer clashes 2405with cp --preserve. Better error message for ls -r on unreadable 2406directories, and ls -Z now uses O_PATH (with the /proc/self/fd/%d 2407workaround for kernel stupidity as necessary).</p> 2408 2409<p>Date now understands @unixtime[.fraction] and uses -D for 2410the set-side format (matching busybox's extension for this). The seq -f 2411string now checks that it's got exactly one %f escape with the correct 2412attributes (and a whole bunch of test cases for it). Fixed a bug 2413in od that screwed up the position indicator on arm and mips. 2414In stat the d/h units moved from %d %D to the default string. 2415And patch can now correctly apply hunks with trailing context to the start of 2416the file.</p> 2417 2418<p>The prompt argument moved out of yesno() (the caller can print the prompt 2419themselves). Replaced toys.exithelp with help_exit(). Added new 2420XVFORK() macro, and xpopen_both() calls /proc/self/exe when passed 2421a NULL argv (see cpio -p for example usage). Replaced toys.recurse 2422with toys.stacktop so the recurse or re-exec decision is now based 2423on bytes of stack space used. Marked a bunch of command-local functions 2424static.</p> 2425 2426<p>New additions to lib/ include strlower(), xconnect(), and the 2427aforementioned help_exit(). 2428The testsuite now has some infrastructure tests based on "example" 2429commands such as toys/examples/test_human_readable.c. 2430The login command finally got a long-overdue cleanup (it's one of the 2431commands that predate the "pending" directory but were part of the reason 2432for it). Hexedit had an 2433uninitialized variable (of course gcc didn't spot it, it was too busy 2434warning about "may be used uninitialized but never actually is" variables).</p> 2435 2436<p>Tweaked makefile so 2437"make CROSS_COMPILE=prefix-" (as well as "CROSS_COMPILE=prefix- make", 2438which still works). Toybox is now installed chmod -w so broken installers 2439(like the bunzip2 package's) that try to overwrite existing binaries won't 2440knock out the whole of toybox. 2441GCC 5.2.0 stopped being able to compile Linux 2.6.12's kconfig, but 2442we added a workaround. You can now build uptime without utmpx.h. 2443Alejandro Joya pointed out that enabling smack required smack on the host 2444as well as target when cross compiling, which is now fixed.</p> 2445 2446<p>Note: toybox can autodetect nommu support when building with a uClibc 2447toolchain such as <a href=http://landley.net/aboriginal/downloads/binaries/old/1.4.3/cross-compiler-sh2eb.tar.gz>the one from Aboriginal Linux</a>, 2448but <a href=http://github.com/richfelker/musl-cross-make>with musl-libc</a> 2449you'll have to enable CONFIG_TOYBOX_MUSL_NOMMU_IS_BROKEN to work around the 2450fact they provide a non-functional fork() implementation that always returns 2451-ENOSYS, to prevent you from compile-time probing for nommu support when 2452cross-compiling. Unfortunately "preventing you from probing" seems to be 2453an explicit policy with musl, they also don't provide an "#ifdef __MUSL__" 2454because their library is perfect and you're only ever allowed to work around 2455other people's bugs, not theirs. So we have to use menuconfig to manually 2456enable musl-specific bug workarounds.</p> 2457 2458<a name="23-07-2015" /><a href="#23-07-2015"><hr><h2><b>July 23, 2015</b></h2></a> 2459<p>I recreated the <a href=downloads/toybox-0.6.0.tar.gz>0.6.0 source tarball</a> 2460(new sha1sum 08fb1c23f520c25a15f262a8a95ea5b676a98d54) 2461because I forgot to add --prefix to the git archive command when I updated 2462my release script from mercurial, so the files weren't in an enclosing 2463directory. (Ooops.)</p> 2464 2465<a name="19-07-2015" /><a href="#19-07-2015"><hr><h2><b>July 19, 2015</b></h2></a> 2466<blockquote><p> 2467The reason why it was published in the form of a micro sub meson electronic 2468component is that if it were printed in normal book form, an interstellar 2469hitchhiker would require several inconveniently large buildings to carry it 2470around in.</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 2471 2472<p><a href=downloads/toybox-0.6.0.tar.gz>Toybox 0.6.0</a> 2473(<a href=https://github.com/landley/toybox/releases/tag/0.6.0>git commit</a>) 2474is out. (Yes, git. See the <a href=#05-04-2015>previous news entry</a>.)</p> 2475 2476<p>Sorry for the unusually long gap between releases. Since last release Ye 2477Olde Project Maintainer traveled to japan twice and had two more "once 2478a century" floods at home. (Probably a coincidence.) Still catching up.</p> 2479 2480<h3><b>CELF/ELC talk and Wikipedia[citation needed] article</b></h3> 2481 2482<p>I gave another State Of The Toybox talk 2483(<a href=https://www.youtube.com/watch?v=04XwAbtPmAg>video</a> 2484<a href=http://landley.net/talks/celf-2015.txt>outline</a>), in which I 2485repeat my <a href=http://landley.net/notes-2013.html#07-11-2013>perennial</a> 2486<a href=https://twitter.com/landley/status/557309224535851009>complaint</a> 2487that Wikipedia[citation needed] 2488<a href=http://en.wikipedia.org/wiki/Toybox>still</a> 2489<a href=https://en.wikipedia.org/wiki/BusyBox#Controversy_over_Toybox>says</a> 2490toybox was relicensed before its hiatus, when relicensing was why 2491the hiatus ended.</p> 2492 2493<p>Since Wikipedia[citation needed] seems unable to do the 2494<a href=#15-11-2011>most</a> 2495<a href=http://landley.net/hg/toybox/log/tip/LICENSE>basic</a> 2496<a href=http://landley.net/notes-2011.html#13-11-2011>research</a> on 2497this point, and has stuck to an incorrect sequence of events for years, 2498I've been gradually escalating my attempts to correct them. Toybox 2499came out of mothballs in November 2011 <b>because</b> it could be 2500relicensed. That's what opened up a new niche busybox wasn't already 2501filling with a 10 year headstart.</p> 2502 2503<a name="asterisk_back" /> 2504<p>The article has plenty of smaller issues<a href=#asterisk>*</a>, but 2505given that I gave an entire talk at Ohio LinuxFest in 2013 2506(<a href=http://landley.net/talks/ohio-2013.txt>outline</a>, 2507<a href=https://archive.org/download/OhioLinuxfest2013/24-Rob_Landley-The_Rise_and_Fall_of_Copyleft.mp3>audio</a>) on why I switched away from GPL for 2508my projects, that one bugs me.</p> 2509 2510<h3><b>New stuff this release</b></h3> 2511 2512<p>There's a new android menu in menuconfig, and rather a lot of Linux 2513Security Module support (Smack for Tizen from Xavier Roche and José Bollo, 2514and SELinux for Android from Elliott Hughes; see 2515the Security Blanket menu under global settings in menuconfig) has 2516trickled in, although there's still more to come.</p> 2517 2518<p><b>New commands:</b> Added reset, nproc, ionice, and iorenice. 2519Elliott Hughes contributed xxd, runcon, 2520restorecon, load_policy, getenforce, setenforce, getprop, and setprop. 2521Promoted shred, nsenter, and hwclock.</p> 2522 2523<p>You can once again build catv now the flag infrastructure's been updated to 2524let it coexist with cat -v. 2525And on a long plane flight I wrote 2526hexedit, an interactive hex editor that implements the start of 2527cursor control infrastructure (for eventual use by less and vi and shell 2528command history and so on).</p> 2529 2530<p><b>New options:</b> Added sed -E as a BSD-compatible synonym for -r. 2531Upgraded oneit with -r (restart), -3 (send exiting PID values to child), 2532and signal handling. Added -v option to timeout, -m to mknod, -u to shred, 2533-t to dmesg, and -123 to head and tail. Added implicit "." to grep -r without 2534any files to work on. Hyejin Kim requested prefix support for truncate -s. 2535Greg Hackman added -inum to find. 2536Jan Cybulski added the smack side of ls -Z support. Various patches also 2537added -Z to mkdir, mknod, and mkfifo. 2538Basic cp --preserve support went in, but not yet the xattr/LSM parts.</p> 2539 2540<p>The toybox command now has a --version option, 2541which uses "git describe" if available.</p> 2542 2543<p><b>Build infrastructure:</b> 2544The "make change" target now saves the output of each failed standalone 2545command build in a .bad file, and "make defconfig" is quieter now.</p> 2546 2547<p>Paul Barker submitted a large patch changing command install paths so 2548"toybox can be installed alongside busybox without confusing 2549update-alternatives". (There's some argument over 2550what the right paths should be, and I'm waiting for 2551people to tell me what else needs fixing because I have no idea. I've 2552been symlinking /bin to /usr/bin since 2002 2553<a href=http://landley.net/writing/hackermonthly-issue022-pg33.pdf>for 2554historical reasons</a>.)</p> 2555 2556<p><b>Docs:</b> The repository link now goes to github, with another link 2557to the commit rss feed.</p> 2558 2559<p>Elliott Hughes updated the Android section of the roadmap 2560(and he would know). Redid bits of scripts/mkstatus.py to make updating 2561status.html easier, and the README is larger.</p> 2562 2563<p>More description of option parsing in code.html, which now describes the 2564FLAG_x macros, switching flag macro sets with FOR_newcommand, how 2565configuration zeroes flag macros and using FORCE_FLAGS to suppress the 2566zeroing of options shared between commands. Also added description of ";" 2567to make --longopts take an optional =value part, and more about TOYBOX_DEBUG 2568to check NEWTOY() option strings (otherwise a bad option string makes 2569lib/args.c obviously segfault, but doesn't explain why).</p> 2570 2571<p>Added a "Why 0BSD?" section to license.html when submitting zero clause bsd 2572to SPDX (according to the pending license spreadsheet, it's been approved for 2573SPDX 2.2).</p> 2574 2575<p>The old list of commands needing cleanup but not in pending was 2576removed from toys/pending/README and instead the issues were added 2577as TODO comments in the individual commands.</p> 2578 2579<p><b>Bugfixes:</b> 2580Fixed mount -a segfaulting without -O (reported by Janus Troelsen), 2581and made it try a "become rw" ioctl() on the block device before falling 2582back to mounting read only (because Android expects that). 2583Fixed printf -- and printf ---. Lots of tweaks to ls -l spacing with 2584different options. Make touch -d and -t actually set time when you don't 2585specify nanoseconds. 2586Fixed a subtle bug where recursive calls (toybox commands that run other 2587toybox commands) weren't resetting all their state. (This manifested as 2588a "no }" error from "find | xargs sed", but could cause other problems.) 2589And David Halls reported another sed bug trying to compile libiconv (which 2590left extra \ at the start of lines in a generated shell script, breaking 2591the build). Output an error message for "cat /mnt".</p> 2592 2593<p>Kylie McClain reported that mktemp broke when $TMPDIR was set to an empty 2594string (which is not the same as unset), that install/find didn't support 2595numeric uid/gids, and that sort -z affects both input and output. 2596Isabella Parakiss fixed a printf.c bug. 2597David Halls fixed bugs in install -D and find -exec. Samuel Holland 2598fixed unshare -r. Hyejin Kim fixed makedevs with a count of 1, fold -w 2599range checking, an error path in scripts/mkflags.c, added -i to dhcpd, 2600and stopped su from prompting the root user for the new user's password. 2601Jan Cybulski spotted wrong indentation when combining ls -s and -i with -C and 2602-x. José Bollo fixed stat %G. Sameer Pradhan fixed a bug in mkfifo -Z.</p> 2603 2604<p>Elliott Hughes asked for a default SIGPIPE handler to disable 2605the signal handler bionic's dynamic loader installs (yes really). Still not 2606100% sure what the correct behavior is there. (Posix is 2607(<a href=http://permalink.gmane.org/gmane.comp.standards.posix.austin.general/10915>actively unhelpful</a>, but at least they're taking 2608<a href=http://austingroupbugs.net/view.php?id=789#c1976>years to 2609make up their mind</a>. Elliott also sent patches to fix a typo in 2610useradd.test, add missing arguments to error_exit() calls and clean up 2611printf() format strings, fix an off by one error in human_readable(), 2612fix dmesg -c error reporting, fix a segfault in comma_scan where the option 2613was the last item in optlist (triggered by mount -o ro,remount), fix 2614hwclock -w, made ifconfig print lowercase MAC addresses (it was bothering 2615him), and make terminal_size() read the right environment variable 2616(LINES, not ROWS). And he suggested the test suite notice high command exit 2617values (corresponding to segfault or other signals).</p> 2618 2619<p>People are apparently using toys/pending commands, despite the police tape 2620and flashing lights, so added louder warnings to toys/pending/README. 2621Elliott Hughes fixed various problems with tar, dd, more, and top. 2622Hyejin Kim cleaned up syslogd and dumpleases. Isaac Dunham added hotplug 2623support to mdev. Yeongdeok Suh added RFC-3315 ipv6 support to dhcpd.</p> 2624 2625<p>I rewrote ps.c from scratch (in pending), but it's not ready for real use 2626yet.</p> 2627 2628<p><b>Portability:</b> 2629On the portability front Bernhard Rosenkranzer fixed a problem where the 2630menuconfig code wouldn't compile in C99 mode. (This led to me documenting 2631the craptacular nature of kconfig in a README, and the plan to replace it 2632sometime before 1.0.) Some extra flags to shut up overzealous llvm warnings 2633were added (and have to be probed for because gcc complains about 2634arguments it doesn't recognize even when they switch stuff _off_ using 2635a standard syntax). Don't depend on malloc(0) to return non-null in ls. 2636David Halls fixed some mac/ios portability issues, 2637implying somebody's built at least part of toybox on a mac.</p> 2638 2639<p>Added basename_r() to lib/lib.c because the posix semantics for basename() 2640are stupid but what the gnu guys did to it was appalling. 2641Turns out bionic already had a basename_r(), but posix still doesn't. 2642Fixed it up in portability.h, but this 2643could break more stuff in future. (Correct fix is to lobby posix to add it, 2644which would probably take about 15 years...)</p> 2645 2646<p><b>Infrastructure:</b> 2647The build now checks $LDFLAGS for linker-only flags, and allows the strip 2648command to fail (binflt toolchains provide a strip that doesn't work). 2649Since time.c uses floating point, added TOYBOX_FLOAT dependency in config.</p> 2650 2651<p>There's a lib/lsm.h defining varous inline functions for linux 2652security modules stuff, if (lsm_enabled()) should turn into a compile-time 2653constant 0 and let code drop out when TOYBOX_LSM_NONE selected, but 2654testing against CFG_TOYBOX_LSM_NONE or derived symbols is still useful 2655becuase when it _is_ enabled the probe turns into a system call you 2656don't want to repeat too much.</p> 2657 2658<p>Switched a bunch of commands from signal() to xsignal(). Factored out 2659xgetgrnamid() and xgetpwnamid() into xwrap.c. Make time.c depend on 2660TOYBOX_FLOAT (since it always uses float so shouldn't be available on 2661build targets without even software float). Added readfileat() to lib/lib.c.</p> 2662 2663<p>The dirtree infrastructure now passes in full flags for the old symlink 2664field, and the new DIRTREE_SHUTUP flag disables warnings if a file vanishes 2665out from under you during traverse. New dirtree_start() wrapper to 2666create dirtree root with only two arguments.</p> 2667 2668<p>The not-curses infrastructure introduced by hexedit mostly moved to 2669lib/interestingtimes.c.</p> 2670 2671<a name="asterisk" /> 2672<a href="#asterisk_back" />Asterisk:</a> such when 2673Tim contacted me (my blog says a couple days before nov 13, 2011, I.E. 267411/11/11 not some specific day 2 months later) to ask if I wanted to work 2675on a new project he was proposing called 2676<a href=http://www.elinux.org/Busybox_replacement_project>BentoBox</a> 2677(because I used to do busybox, he'd forgotten toybox existed 2678until I brought it up). And don't ask me what "focuses not on compatibility 2679with its GNU counterparts" means when CP_MORE adds 7 non-posix options 2680and toys/other has 84 commands in neither posix nor LSB. I think they're 2681struggling to explain the difference having dismissed "licensing" as being 2682the reason it started up again after a long hiatus? The reason I don't think 2683GNU is special is there are a half-dozen other independent 2684implementations of the same unix command tools out there (AT&T, 2685BSD, Coherent, Minix, plan 9, busybox, toybox, and several more analyzed in 2686the <a href=roadmap.html>roadmap</a>, and that's ignoring the implementations 2687written for DOS or in assembly over the years). But I do care what 2688Linux From Scratch expects, and if it's 2689<a href=http://archive.linuxfromscratch.org/lfs-museum/7.6/LFS-BOOK-7.6-NOCHUNKS.html#ch-tools-gcc-pass1>calling mv -v</a> 2690then I impelement mv -v 2691even if <a href=http://landley.net/toybox/roadmap.html>posix hasn't got 2692it</a>. And I don't know why "gnu counterparts" would describe this when 2693util-linux isn't a gnu package, nor are info-zip, e2fsprogs, kmod, less, 2694procps, shadow, sysklogd, vim, zlib, sudo, dhcpcd...</p> 2695 2696<a name="05-04-2015" /><a href="#05-04-2015"><hr><h2><b>April 5, 2015</b></h2></a> 2697<p>Since <a href=https://android.googlesource.com/platform/external/toybox/>android</a> and 2698<a href=https://git.tizen.org/cgit/platform/upstream/toybox.git>tizen</a> 2699and <a href=https://github.com/kraj/meta-musl/tree/master/recipes-core/toybox>openembedded</a> 2700and <a href=https://packages.gentoo.org/package/sys-apps/toybox>gentoo</a> 2701and so on have all been using Georgi Chorbadzhiyski's git mirror rather 2702than the mercurial repository, I bit the bullet and switched the project's repo 2703<a href=https://github.com/landley/toybox>to git</a>. Georgi's 2704<a href=https://github.com/gfto/toybox>mirror</a> is now pulling from that.</p> 2705 2706<a name="25-02-2015" /><a href="#25-02-2015"><hr><h2><b>February 25, 2015</b></h2></a> 2707<blockquote><p>"A common mistake that people make when trying to design 2708something completely foolproof is to underestimate the ingenuity of 2709complete fools."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 2710 2711<p><a href=downloads/toybox-0.5.2.tar.gz>Toybox 0.5.2</a> 2712(<a href=/hg/toybox/shortlog/1702>commit 1702</a>) is out.</p> 2713 2714<p>New promoted commands: sed (finally fixed enough it builds Linux From 2715Scratch), printf (cleaned up and promoted), shred and 2716base64 (the Tizen guys wanted them), getenforce, setenforce, and chcon (android), 2717mix (promoted with fixes from Isaac Dunham), nsenter (from 2718Andy Lutomirski, merged into unshare).</p> 2719 2720<p>Elliott Hughes submited a bunch of patches to support Android (to 2721both toybox and Bionic libc, which he maintains). On toybox's end this 2722involved a lot of fixups to portability.[ch] and fixes to over a dozen 2723commands, plus several new ones. Other portability fixes included working 2724with buildroot's uclibc fork and building for nommu targets.</p> 2725 2726<p>The new "make change" target builds each toybox command as a standalone 2727binary. Rather a lot of commands that didn't build by themselves (mv depending 2728on cp and so on) were hit with a large rock until they built standalone. 2729This involved rewriting bits of option parsing, more elaborate dependency 2730generation, making each command have its own config 2731symbol and main() function (even when it's just a wrapper calling another 2732command's main()), and so on. Also, some commands can't be built standalone 2733at a conceptual level: "help" describes other enabled commands and "sh" 2734has a number of bulitin commands (cd, exit, set) that require the 2735multiplexer infrastructure, so "make change" filters them out.</p> 2736 2737<p>The mailing list's web archive is still screwed up. Dreamhost has 2738been trying to fix it since approximately September. There are 2739<a href=http://www.mail-archive.com/toybox@lists.landley.net/>two</a> 2740<a href=http://news.gmane.org/gmane.linux.toybox>other</a> less broken 2741archives, but neither has quite the same UI as mailman.</p> 2742 2743<h3>Bugfixes and tweaks</h3> 2744 2745<p>Cynt Rynt sent in tests for ifconfig, 2746Robert Thompson taught factor to accept whitespace separated arguments, 2747Hyejin Kim pointed out that some of mktemp's longopts were attached to 2748the wrong short options, 2749Luis Felipe Strano Moraes fixed a wrong free() call in bootchartd in pending. 2750Patches from Ashwini Sharma to make "df /dev/node" work, prevent du from 2751looping endlessly following symlinks, and to make expr.c 2752(in pending) understand == and regex matches. (Speaking of expr, it gets 2753priority groupings wrong but the bug was actually in the posix spec's 2754HTML conversion. They fixed the posix spec upstream for us. Still need 2755to fix the expr code, but it's in pending for a reason...)</p> 2756 2757<p>Some commands grew new option flags, such as cp --remove-destination 2758and touch -h.</p> 2759 2760<p>The parallel build has better error reporting now. When toybox needs to 2761re-exec itself to regain suid root permissions and hasn't got the suid bit, 2762it now gives the right error message ("not root" instead of "no such command"). 2763 2764<p>Added a test to "mount" to not mount the same device/directory combination 2765over itself (the OS catches this for block devices, but not for tmpfs). 2766Make blkid distinguish ext3 from ext4. Added catv back into cat (because 2767the Android guys wanted it, and they have historical usage on their side, 2768so...). Handle nanoseconds in touch.</p> 2769 2770<p>Fixed a segfault when CP_MORE was disabled (the resulting option flag list 2771no longer defined -d but still had it in option groups at the end). 2772Workaround for glibc redefining dirname() and basename() to random non-posix 2773semantics because gnu. (They could have created dirname_r() but didn't want 2774to.)</p> 2775 2776<p>Fix an ifconfig test that was preventing assigning an ipv4 address to 2777interface aliases. Several cleanup passes on hwclock but not quite 2778promoted out of pending yet.<p> 2779 2780<p>Fixed a wrong error message in rm (if you had a chmod 000 directory and 2781did rm -r on it without -f, after the prompt it would complain it was a 2782directory, which was not the problem).</p> 2783 2784<p>The gzip compression code now does "store only" output to stdout, for 2785what that's worth.</p> 2786 2787<p>Cleanup mountpoint and expand, and remove them from toys/pending/README 2788(a list of commands that predate the toys/pending directory but needed 2789another pass).</p> 2790 2791<h3>Library and infrastructure:</h3> 2792 2793<p>Reworked the option parsing infrastructure so more commands build 2794standalone (via scripts/single.sh or "make change"). The option flag bit 2795values are no longer packed, it leaves spaces where currently disabled 2796flags go, and you can #define FORCE_FLAGS so disabled flags aren't zeroed. 2797This allows multiple commands to more easily share infrastructure, even if 2798your current flag context is for a disabled command (switched off in config), 2799you can force them to stay on and as long as the flags read the same right 2800to left they'll have the same values.</p> 2801 2802<p>We've started removing use of strncpy() because it's a hugely broken 2803standard C function: the length is the maximum length to _append_, not 2804the size of the destination buffer. It memsets the remaining space it didn't 2805copy ala "memset(dest+strlen(dest), 0, len);" so 2806if you think len is the size of dest you're guaranteed to stomp memory off the 2807end). And if it runs out of space it won't null terminate because reasons. 2808(Meanwhile sprintf("%*s", len, str) is counting wide characters in your current 2809locale, so if you set a locale other than "C" it will also go past your 2810allocated buffer size. Whoever is maintining the C library standards is really 2811bad at strings.) 2812Instead we have xstrncat() which will error_exit() if src+dest+1 doesn't 2813fit in the buffer. (Because randomly truncating input data isn't necessarily 2814an improvement.) And there's always xmprintf().</p> 2815 2816<p>Similarly, strtol() doesn't return an error indicator on overflow, 2817you have to clear and then check errno. So new xstrtol() that cares 2818about overflow.</p> 2819 2820<p>The bionic and musl guys agree faccessat(AT_SYMLINK_NOFOLLOW) is not 2821supported, so stop using it.</p> 2822 2823<p>Fixed toy_exec() to detect when argc is in optargs, so we don't 2824need a separate xexec_optargs().</p> 2825 2826<a name="18-02-2015" /><a href="#18-02-2015"><hr><h2><b>February 18, 2015</b></h2></a> 2827<p>Dreamhost continues to be unable to make mailing list archives work, so 2828here's <a href=http://www.mail-archive.com/toybox@lists.landley.net/>another 2829list archive</a> with a less awkward interface than gmane.</p> 2830 2831<p>(Neither gives you the convenient historical monthly views of mailman, 2832but I still have hopes dreamhost will someday figure out what they're doing 2833wrong. They've only been trying since October. Last month they did a 2834<a href=http://www.dreamhoststatus.com/2015/01/14/discussion-list-hardware-maintenance/>hardware upgrade to fix a software problem</a>, and the stale 2835data loads much faster now, so that's something.)</p> 2836 2837<p>Update (Feb 19): the archive started updating again, by discarding 2838all the pending data. So there are now _two_ giant holes in Dreamhost's 2839web archive, from Dec 15-Jan 3, and then another hole from Jan 16-Feb 18. 2840The relevant messages are in both of the other archives. Here's hoping 2841the chronic archive constipation problem won't happen a sixth time.</p> 2842 2843<a name="30-12-2014" /><a href="#30-12-2014"><hr><h2><b>December 30, 2014</b></h2></a> 2844<p>Due to Dreamhost's <a href=http://landley.net/dreamhost.txt>ongoing</a> 2845<a href=http://landley.net/dreamhost2.txt>inability</a> to make mailman 2846work reliably, I've added a link to a backup web archive at 2847<a href=http://news.gmane.org/gmane.linux.toybox>gmane</a> to the nav bar 2848on the left.</p> 2849 2850<p>You still subscribe to the list through 2851<a href=http://lists.landley.net/listinfo.cgi/toybox-landley.net>the first link</a>.</p> 2852 2853<p>Update (January 27, 2015): they're <a href=https://twitter.com/landley/status/558428839462703104>still working on it</a>.</p> 2854 2855<a name="19-11-2014" /><a href="#19-11-2014"><hr><h2><b>November 19, 2014</b></h2></a> 2856 2857<blockquote><p>"This time it was right, it would work, and no one would have to get nailed to anything."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 2858 2859<p><a href=downloads/toybox-0.5.1.tar.bz2>Toybox 0.5.1</a> 2860(<a href=/hg/toybox/shortlog/1566>commit 1566</a>) is out.</p> 2861 2862<p>It's an interim release, mostly bugfixes. There are several new commands, 2863but they're all in pending.</p> 2864 2865<h3>Development</h3> 2866 2867<p>Finally implemented sed, which is still in pending because although 2868it's feature complete according to posix, and even passes the parts of 2869Busybox's sed test suite that aren't explicitly testing for gnu bugs we 2870don't want to copy, it's not yet good enough to build Linux From Scratch. 2871(The ./configure stages use very long sed scripts. 20 commits worth of 2872implementation and debugging, just under 1000 lines of code, and there's 2873still more to do. We're definitely up to some of the "fiddly" commands now. 2874Did you know "echo hello | sed p - -" segfaults gnu sed in Ubuntu 12.04? 2875Yeah...)</p> 2876 2877<p>Talked with the Tizen developers to follow up on their desire to 2878make toybox a part of the base Tizen system, and got a list of commands 2879to add to the roadmap. The tizen todo list is:</p> 2880 2881<blockquote><p> 2882wget, sha256*, gzip, gunzip, bunzip2, rsync, zdiff*, 2883less, ar, arch, base64, csplit, dir, fmt, join, 2884nproc, shred, shuf, stdbuf, stty, test, tr, unexpand, 2885users, vdir, diff3, sdiff, dosfsck (fsck.vfat), awk, fdisk 2886</p></blockquote> 2887 2888<p>(Most of which was already on the todo list, but it helps prioritize.)</p> 2889 2890<p>Fixed md5sum and sha1sum on big endian systems (reported by James McMechan). 2891Andy Lutomirski fixed unshare's help text and option parsing, 2892and submitted nsenter (a tool to use setns(2)) to pending. 2893Isaac Dunham implemented acpi -ctV options, and spotted the bug that ls -d 2894was inappropraitely following command line symlinks without -H or -L (it 2895should act like ls -l does), and ls -F handles symlinks wrong too. 2896Lukasz Szpakowski sent in two bugfixes to tail.c. Cynt Rynt spotted an 2897unnecessary assignment in lib/password.c.</p> 2898 2899<p>Ashwini Sharma's team was as busy as usual, submitting tr, crontab, and 2900ipcrm, and hwclock to pending, more features to the pending ip.c, and a 2901pile of bugfixes (to chgrp, killall, ifconfig, insmod, 2902losetup, comm, cp, id, xwrap, netcat, modprobe, nohup...) mostly found by 2903static analysis. (These fixes are mostly to seldom-used codepaths like the 2904TOYBOX_FREE config option, but test coverage is always appreciated.) Ashwini 2905also suggested upgrading ln -f to leave the original target alone if link 2906creation fails, and reported that mv -f and -i weren't implemented (now fixed).</p> 2907 2908<p>New config option: TOYBOX_NORECURSE prevents xexec() from making internal 2909function calls (for nommu systems with a finite stack).</p> 2910 2911<p>The "toybox" multiplexer command no longer adds a trailing space to each 2912line of command names, so things like "./toybox | tr ' \n' '|'" to create 2913a grep pattern snippet are easier to do. (Why you'd want to is your business, 2914but the output is tidier now.)</p> 2915 2916<h3>Infrastructure</h3> 2917 2918<p>Isaac Dunham added Android support to portability.h, including compile 2919probes for functions missing from bionic-libc, and annotated the commands that 2920use those functions. We haven't really tested building against bionic, 2921but in theory it's possible now.</p> 2922 2923<p>Running the test suite now color codes the PASS/SKIP/FAIL notifications 2924if output is to a tty. (And in case you missed it last time, VERBOSE=fail 2925to stop at the first failure is really useful.)</p> 2926 2927<p>In loopfiles_rw() use O_CLOEXEC instead of O_RDONLY to request the loop 2928function close filehandles for us. (Otherwise the callback function must 2929close each supplied filehandle itself.)</p> 2930 2931<p>The printf-style escape parsing ("\n" and friends) got factored out into 2932a new unescape() function.</p> 2933 2934<a name="02-10-2014" /><a href="#02-10-2014"><hr><h2><b>October 2, 2014</b></h2></a> 2935<blockquote><p>"There is an art, it says, or rather, a knack to flying. 2936The knack lies in learning how to throw yourself at the ground and miss... 2937Clearly, it is this second part, the missing, which presents the 2938difficulties."</p><p>- The Hitchhiker's Guide to the Galaxy<p></blockquote> 2939 2940<p><a href=downloads/toybox-0.5.0.tar.bz2>Toybox 0.5.0</a> 2941(<a href=/hg/toybox/shortlog/1512>commit 1512</a>) is out.</p> 2942 2943<h3>New commands</h3> 2944 2945<p>The new commands are find, install, factor, and mount. Promoted commands 2946(cleaned up and moved out of "pending") are lspci, inotifyd, and blockdev.</p> 2947 2948<p>cp now implements -HL and -F to force delete of pending files, cpio now 2949ignores -m and implements -p, ls -C now has utf8 support (using wcwidth 2950instead of strlen), and umount got a number of upgrades involving 2951looking things up in /proc/mounts. Other minor cleanups happend to 2952cut, touch, free, and id.</p> 2953 2954<p>In pending: Bradley Controy submitted mix (adjusts OSS sound volume). Ashwini 2955Sharma submitted diff, userdel, blockdev, ipcs, and crond, upgraded 2956fdisk, fsck, and ftpget, and ran a static analyzer on a lot of other code. 2957Partial cleanup was done to useradd, userdel, groupadd, and groupdel.</p> 2958 2959<h3>Build infrastructure</h3> 2960 2961<p><b>Parallel builds</b></p> 2962 2963<p>The build now takes advantage of SMP, autodetecting the number of 2964processors. (Export the environment variable CPUS to pick a specific number.) 2965Other build changes: split out $LDOPTIMIZE because old compilers complain 2966about linker options passed with -c, and the entire "generated" directory now 2967gets deleted by clean (the README that was in there got merged into code.html).</p> 2968 2969<p><b>Standalone builds</b></p> 2970 2971<p>The standalone build infrastructure (scripts/single.sh) got upgraded to 2972build more commands as standalone executables. In make.sh the source file 2973selection uses a regex to find the source files with the NEWTOY/OLDTOY macro 2974for the command. It enables each command's 2975sub-options (so CP has CP_MORE), enables I18N and FLOAT support to build 2976full-featured commands, and includes --help text (at least when 2977the command doesn't use another command's help). The OLDTOY() macro 2978now produces (redundant) function prototypes so you can build an OLDTOY 2979without the NEWTOY</p> 2980 2981<p>It doesn't quite have complete coverage yet, the defconfig entries that 2982aren't building standalone yet are:</p> 2983 2984<blockquote><p>chown, egrep, fgrep, fstype, halt, mv, nc, poweroff, unix2dos, 2985whoami</p></blockquote> 2986 2987<p>The main reason for standalone build failures is NEWTOY() or OLDTOY() 2988entries that don't have their own config symbol. Another problem is entries 2989that depend on another entry in kconfig, usually because common infrastructure 2990is using one command's flags (which the other commands copy): if that command 2991is disabled, the FLAG macros become 0 so dead code elimination can remove the 2992code. It's <a href=http://landley.net/hg/toybox/rev/1503>possible 2993to untangle</a> this, but a bit awkward. (It boils down to conflicting 2994design goals in the two contexts.)</p> 2995 2996<p>Standalone builds are used by the test suite when testing individual 2997commands. 2998 2999<p><b>Snapshot builds</b></p> 3000
3001<p>A new addition to the "generated" directory is generated/build.sh 3002containing a single compiler command line to build toybox in its current 3003configuration. Combined with the generated/*.{h,sh} files from an 3004exisiting build, this may let you build on a new system that hasn't quite 3005got enough OS bits working to run a full configureand make.</p> 3006 3007<h3>Internals</h3> 3008 3009<p>Library code: xcreate/xopen now O_CLOEXEC by default to avoid leaking 3010filehandles to child processes. DIRTREE_COMEAGAIN's second callback is now 3011done with the directory filehandle still open (new dir->again variable added 3012to distinguish first from second callback, and requesting DIRTREE_RECURSE now 3013requires passing in the specific macro value, not just a true/false). 3014Use daemon() out of libc instead of hand-rolled daemonize() in various 3015pending commands. string_to_mode() now passes through type bits so you can 3016use it to more easily modify a file's existing mode. 3017Split xpopen() into xpopen_both(), xopen(), and xrun() depending on whether 3018we want to redirect both, one, or neither of stdin/stdout.</p> 3019 3020<p>Bugfixes: Better error message when TOYBOX_SUID option can't drop priviliges 3021(which happens when you suid something _other_ than root). 3022The old pending version of nbd_client.c wasn't deleted when the 3023command was promoted (and the build would break if both were enabled), 3024toy_exec() sometimes needs to re-exec from $PATH rather than recurse 3025internally (to gain dropped root permissions or limit stack depth), 3026always call setlocale() when I18N is enabled to switch it back _off_ when 3027we run commands that expect sscanf("%n") to return bytes, 3028dirtree() had a memory leak in an error path, patch.c had some bugs in 3029error paths (didn't report problem clearly). Ashwini Sharma spotted an 3030option parsing bug where [-abc] would forget _all_ command line arguments 3031saved in the GLOBALS() block (not just the ones for options being switched 3032off), plus various minor fixes to nbd_client and cpio. 3033Lukasz Szpakowski fixed rm -f on a broken symlink (failed), and killall 3034with no arguments (segfaulted).</p> 3035 3036<p><b>Portability</b></p> 3037 3038<p>A somewhat fiddly fix to rm -rf (which needs to chmod directories to u+rwx 3039to descend into them) which hit a musl bug in faccessat() which the musl 3040maintainer refuses to fix. (He literally wants the man page changed 3041instead, despite other libcs working.) Added an #ifdef __MUSL__ section 3042to portability.h with a workaround, you may need CFLAGS=-D__MUSL__ in your 3043build if your musl build's features.h doesn't #define that. (I may do 3044a different workaround in future, but sometimes you've just got to make 3045it work so you can ship. Also, toybox grep with multiple patterns 3046requires <a href=http://landley.net/hg/aboriginal/rev/1692>a patch 3047to musl's regex engine</a>, which applies to 1.1.4 but not to the current 3048musl source control.)</p> 3049 3050<p>More portability.h fixes for uClibc too. (I don't expect that to ever have 3051another release, so locally patching around posix-2008 violations is silly).</p> 3052 3053<p><b>Change to username filtering</b></p> 3054 3055<p>Posix recommends the username creation logic filter usernames to a small 3056allowed set of characters (which even Red Hat breaks by explicitly allowing 3057"$" at the end), but this prevents UTF-8 usernames. Posix' stated logic 3058is to allow filesystems to create the user's home directory, but Linux 3059filesystems can accept any character but NUL and "/". The only characters 3060we actually _need_ to filter out are ":" (field separator in passwd), 3061newline (line separator in passwd), and "/" (directory separator in 3062filesystem).</p> 3063 3064<h3>Documentation</h3> 3065 3066<p>Web pages updated: cleanup.html documents more cleanup, code.html 3067documents more code, and about.html now capitalizes "toybox" consistently 3068(it's just a word, capitalize at start of sentence).</p> 3069 3070<p>The pending/README file now lists commands that needed review/cleanup 3071before the pending directory was added.</p> 3072 3073<h3>Test Suite</h3> 3074 3075<p>Moved out of scripts/test into top level "tests" directory, and the 3076testing.sh script is now in scripts rather than mixed into the *.test files.</p> 3077 3078<p>Johan Bergström requested VERBOSE=fail to make tests (telling it to 3079stop at the first failure), and spotted a build bug where using gnu 3080sort on the host broke in non-C locales.</p> 3081 3082<p>Divya Kothari submitted tests for chmod, link, tar, bzcat, xzcat, zcat, 3083and hostname. (And more, but that's all that's merged so far.)</p> 3084 3085<a name="07-07-2014" /><a href="#07-07-2014"><hr><h2><b>July 7, 2014</b></h2></a> 3086<blockquote><p>"This planet has - or rather had - a problem, which was this: 3087most of the people living on it were unhappy for pretty much of the time. Many 3088solutions were suggested for this problem, but most of these were largely 3089concerned with the movement of small green pieces of paper, which was odd 3090because on the whole it wasn't the small green pieces of paper that were 3091unhappy."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3092 3093<p><a href=downloads/toybox-0.4.9.tar.bz2>Toybox 0.4.9</a> (<a href=/hg/toybox/shortlog/1385>commit 1385</a>) is out.</p> 3094 3095<p><b>New commands</b> added to pending include: 3096lsattr, chattr, inotifyd, rfkill, sulogin, strings, makedevs, 3097killall5, and tar from Ashwini Sharma, arp from Kyungwan Han, 3098sysctl by Bilal Qureshi, partprobe from Bertold Van den Bergh, 3099host from Rich felker, and I did nbd-client and the first 2/3 of mount.</p> 3100 3101<p>Finished cleanups (commands promoted out of pending): 3102sysctl, rfkill, strings, mkpasswd, makedevs, partprobe, killall5, 3103fallocate, and nbd-client.</p> 3104 3105<p>(Along the way partial cleanups got made to: last, fold, lspci, ps, 3106bootchartd, init, fsck, telnetd, telnet, vconfig, toysh, iconv, useradd, 3107login, host, openvt, deallocvt, getty, tftpd, and modprobe. But there's 3108still more to do on all of those.)</p> 3109 3110<p>This time around the <a href=bin>static binaries</a> are linked against 3111musl instead of uClibc. (That's why there's no sparc version, musl doesn't 3112support that target yet.)</p> 3113 3114<p><b>Documentation:</b></p> 3115 3116<p>The help text parser expects lower case "usage:" lines with 3117a blank line after them, so go through and regularize those. Expand the 3118"coding style" section in the docs and move it to design.html. (Not a show 3119stopper for incoming 3120contributions, just an explanation of some of the things I'll do to them 3121during cleanup.) The help text for the "toybox" command now includes 3122the shell script snippet to install symlinks to the toybox binary.</p> 3123 3124<p>The <a href=cleanup.html>cleanup page</a> now has descriptions for the 3125full ifconfig cleanup series, among others.</p> 3126 3127<p>The new toys/examples directory contains hello.c and skeleton.c. The first is 3128a simple hello world program in toybox style, the second is a much more 3129elaborate example program using showing how to use the command line option 3130parsing and how to provide multiple commands in the same C file.</p> 3131 3132<p><b>Fixes</b>:</p> 3133 3134<p>Fix od bug reported by Samuel Holland ("od -v -b" was appending the default 3135output type even though an output type was specified). Ashwini Sharma reported 3136bugs where readfile() was incorrectly freeing its buffer, and where toy_init() 3137was zeroing the wrong data because the field it was using to measure (rebound) 3138had moved (when I moved it back I added a comment why the field needs to be 3139there), fixed a segfault in the dhcp client, and made a 0 length read at 3140the start of password entry count as EOF. Make the "we are not root" test 3141in the init code show the help text. Posix implies that fflush() can return 3142success even when the stream's error bit is set, so call both fflush() and 3143ferror() from xprintf().</p> 3144 3145<p>Isaac Dunham pointed out that bloatcheck couldn't deal with diff 3146implementations that only implement "unified diff" format, and that some 3147diff implementations can't handle nonseekable input (I.E. reading from 3148a pipe). Bugfix so "help -a" works again. Option parsing on nohup now stops 3149at first nonoption argument. Fix segfault in "which" if PATH wasn't set, 3150which was actually a bug in lib function find_in_path(). Made rm -rf of 3151chmod 000 directories actually remove them.</p> 3152 3153<p>The build now passes the same $CFLAGS to the library probe as the final 3154build, because arch linux is so broken it provides different sets of 3155libraries for static and dynamic linking.</p> 3156 3157<p>It turns out sprintf("%.123s", str) is counting characters, not bytes, 3158so globally enabling locale support opens stack smashing vulnerabilities. 3159So there's a new TOYFLAGS_LOCALE you set in toyflags when you want the 3160setup code to setlocale().</p> 3161 3162<p><b>Upgrades:</b></p> 3163 3164<p>Isaac Dunham extended cpio to archive unreadable empty files, and I taught it 3165to set uid/gid and timestamp when extracting archives. Isaac also 3166added tests for cpio, link, and du, added lspci -i, made the pci database 3167parsing skip # comment lines, merged logname and whoami into id.</p> 3168 3169<p>Daniel Verkamp sped up md5sum about 30% with some loop unrolling, making 3170it actually smaller in the process. I added -b flags to md5sum and sha1sum 3171for "brief" output that's just the hash with no filename. (I'm aware other 3172implementations use that for MSDOS "binary" mode, and don't care.)</p> 3173 3174<p>When building standalone commands (scripts/singleconfig.sh commandname), 3175the build now switches on all the sub-options of the command so we get 3176a standalone version with all the bells and whistles enabled.</p> 3177 3178<p>Add -ds flags to date and document +FORMAT escapes. Add the shell NOP 3179command ":" as an alias for true (for toysh).</p> 3180 3181<p>Add uClibc probe for iconv() and fallocate. (The fact it didn't always 3182build against uClibc is why fallocate wasn't enabled in defconfig before.)</p> 3183 3184<p>The umount command now does an losetup -d on the device by default, so 3185we don't leak loopback devices. Bugfix to losetup so "losetup /dev/loop0 3186filename" actually works again.</p> 3187 3188<p>Divya Kothari sent in test suite entries for ls, ln, rm, mv, printf, dd, 3189and renice. Then a second round for lsattr/chattr, mount, chmod, pgrep/pkill, 3190groupadd, groupdel, and useradd. Several of these uncovered bugs, still 3191working to fix them.</p> 3192 3193<p>There are now free() functions for the predefined llist types and a 3194dlist_terminate() function to break doubly linked lists. The new 3195generic_signal() handler either sets "toys.signal" or writes a byte 3196to toys.signalfd with the signal number if signalfd isn't -1 (which it's 3197initialized to in toy_init).</p> 3198 3199<p>The option parsing logic can now detect when a double fits in a long and 3200use the more precise type for floating point arguments (the FLOAT macro 3201contains the type used). The human_readable() function now just outputs 3202decimal kilo/mega/gigabytes (so when du -u says 5.0G it means 5.0 billion 3203bytes). The build infrastructure now notices duplicate commands (so if you 3204cp toys/pending/command.c toys/other/command.c and forget to delete the 3205first one, the build break is now more informative).</p> 3206 3207<a name="20-04-2014" /><a href="#20-04-2014"><hr><h2><b>April 20, 2014</b></h2></a> 3208<blockquote><p>And to this end they built themselves a stupendous supercomputer 3209which was so amazingly intelligent that even before the data banks 3210had been connected up it had started from "I think therefore I am" and got as 3211far as the existence of rice pudding and income tax before anyone managed to 3212turn it off.</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3213 3214<p><a href=downloads/toybox-0.4.8.tar.bz2>Toybox 0.4.8</a> is based on 3215<a href=http://landley.net/hg/toybox/shortlog/1262>commit 1262</a>. And 3216about time too.</p> 3217 3218<p>The big news is that the build no longer needs python to generate help.h, 3219that's now done in C. The help text generation is also collating help text 3220from multiple options, merging command line option blocks and usage: lines. 3221There's even a new <a href=help.html>help web page</a>.</p> 3222 3223<p><b>New commands:</b> Ifconfig, cpio, and su were cleaned up the rest of the 3224way and promoted out of pending. That saga is mostly explained on the 3225<a href=cleanup.html>cleanup page</a>. Vivek Bhagat's freeramdisk, 3226Isaac Dunham's fsfreeze, and Felix Janda's iconv are also new.</p> 3227 3228<p><b>In pending:</b> 3229Ashwini Sharma's team submitted tcpsvd, udpsvd, telnet, telnetd, last, more, 3230groupdel/delgroup, arping, brctl, ftpget, ftpput, printf, reset, and added 3231ipv6 support to traceroute. Kyungwan Han's team submitted modprobe and getty. 3232Vivek Bhagat submitted openvt and deacllocvt. Samuel Holland submitted fold. 3233I wrote a new inflate (zip/zlib/gzip decompression) implementation in 3234compress.c, and still need to do a corresponding deflate (compression-side) 3235and plug them into gzip and zip and so on. (Right now it does zcat.)</p> 3236 3237<p>Several commands (vmstat, login, du, vconfig, mountpoint, free, chroot, 3238cut, touch, modinfo, expand) predate the "pending" directory, and are thus 3239in other directories but still need cleanup. Of these, vmstat got some 3240work this time (which would be much easier other vmstat implementations 3241documented what their output actually meant).</p> 3242 3243<p><b>Upgrades:</b> Ifconfig grew /prefix netmask support (ala 1.2.3.4/24). Grep now has -zZ to 3244handle null terminated data, cksum grew -H for hex output. Upgraded od so the 3245fields align better when producing multiple output types. Help has -a and -h 3246options (all commands, html output). 3247Bugfix to blkid building for a 32 bit target. The date command can actually 3248set dates now. The O_NOFOLLOW compile time probe didn't work with cross 3249compiling, so it's back to an #ifdef test in portability.h. Nathan McSween 3250sent in a bugfix to od and a portability fix in the common library code. 3251Ashwini Sharma spotted a bug in pidof -o, and added verbose (-v) options 3252to mkdir and ln, and suggested killall should have an -s option and 3253allow -l to take zero arguments. Ashwini Sharma and Felix Janda upgraded 3254tftpd. Fixed dumpleases still using toynet.h after 3255that was removed. Corrected killall return code and error reporting. 3256Isacc Dunham fixed bugs all over the tree, did cleanup on a bunch of 3257pending commands (getty, ftpget, init, openvt, modprobe...), and clarified 3258find's help text. Tom Sparrow ran three different static analyzers on 3259the code, which resulted in a few cleanups. The peek()/poke() functions 3260now use "volatile" to prevent broken compiler "optimizations" to do with 3261aliasing.</p> 3262 3263<p><b>Build stuff:</b> Each FOR_xxxx macro now has a complementary CLEANUP_xxxx macro, so you 3264can put multiple commands with different command line options in the same 3265.c file, so they can share infrastructure outside of lib. (This let the 3266bunzip logic move out of lib into bzcat.c.) See XXX for example. 3267i 3268<p>The headers #included in toys.h are now grouped by standard, and headers 3269not listed in Posix or LSB were moved to portability.h. The old xregcomp.h 3270was folded into lib.h because it's posix (and supporting oddball uClibc 3271configurations isn't as important as it once was).</p> 3272 3273<p>Regression tested against Ubuntu 8.04 to fix up bit-rot in defconfig 3274build on older systems. (We depend on Posix-2008, but not necessarily 3275the absolute latest build environment.)</p> 3276 3277<p><b>In lib</b>: lib/xwrap.c added xgetpwnam(), xchroot(), and lib/lib.c now has names_to_pid(). 3278xsetuid() was replaced with xsetuser() which takes a struct passwd 3279and sets both gid and uid, mkpathat() got factored out into a library command, 3280get_int_value() became atolx_range(), and 3281xmsprintf() is now just xmprintf(). The bunzip2 logic moved from lib into 3282bzcat.c.</p> 3283 3284<p><b>Documentation</b>: new <a href=help.html>help page</a> with the 3285help text for all the defconfig commands, using the new help -ah output. 3286The <a href=code.html>source code walkthrough</a> now says more about 3287#including header files, and how the generated/* directory works. The 3288<a href=design.html>design page</a> has some new paragraphs about trading 3289of different kinds of simplicity, and why comments aren't a substitute for 3290good code. The README no longer trails off into obvious unfinished confusion 3291at the end. Each page on the website should now have its own title.</p> 3292 3293<a name="18-11-2013" /><a href="#18-11-2013"><hr><h2><b>November 18, 2013</b></h2></a> 3294<blockquote><p>"Space," it says, "is big. Really big. You just won't believe how vastly, hugely, mindbogglingly big it is. I mean, you may think it's a long way down the street to the chemist's, but that's just peanuts to space."</p><p>- 3295The Hitchhiker's Guide to the Galaxy</p></blockquote> 3296 3297<p><a href=downloads/toybox-0.4.7.tar.bz2>Toybox 0.4.7</a> is based on 3298<a href=http://landley.net/hg/toybox/shortlog/1122>commit 1122</a>.</p> 3299 3300<p>New commands: Brad Conroy submitted blkid. Elie De Brauwer submitted 3301reboot, halt, and poweroff. Strake's nl got cleaned up and promoted from 3302pending to posix. In addition, the existing chvt and vconfig got some 3303cleanup.</p> 3304 3305<p>That said, I haven't nearly kept up with the flood of new commands going 3306into pending: Ashwini Sharma's team submitted 3307dd, dumpleases, traceroute, top, useradd, groupadd, mkpasswd, tftpd, and 3308an fsck wrapper (with no filesystem drivers yet). Isaac Dunham sent in cpio.</p> 3309 3310<p>Bugfixes: Jeroen van Rijn added a user count to uptime. Elie De Brauwer 3311added -e to watch, removed a memory leak, and fixed a terminal size problem. 3312William Haddon made xargs call its command line once even with blank input 3313(the standard is vague, but builds expect it), and fixed an off by one bug 3314where grep didn't malloc enough space with -E (leading to a segfault). 3315I fixed a glitch in bunzip2 (same one as went into busybox since they're using 3316the code I wrote), in od to fix -t co, -J, and -c options. Add uname -o as a 3317synonym for -s. Build fix to never use $CC without prefixing it with 3318$CROSS_COMPILE (since $HOSTCC could be different). Anca Emanuel spotted 3319a typo in the web page.</p> 3320 3321<p>The compile-time command line option parsing got rewritten (ported from 3322bash to C), which should speed up builds a bit and allow code controlled by 3323--longopts to drop out properly when disabled in the configuration. Terminal 3324querying got refactored. Patch's -x option is now more informative (a 3325debug thing if you're trying to figure out why a patch didn't apply). 3326The "toynet.h" file got folded into toys.h since musl supports it and 3327micromanging uClibc options isn't very interesting anymore. The test suite 3328now uses scripts/single.sh when testing a single command.</p> 3329 3330<a name="17-09-2013" /><a href="#17-09-2013"><hr><h2><b>September 17, 2013</b></h2></a> 3331<blockquote><p>"Think of a number," said the computer, "any number." 3332Arthur told the computer the telephone number of King's Cross railway 3333station passenger inquiries, on the grounds that it must have some function, 3334and this might turn out to be it.</p><p>- The Hitchhiker's Guide to the Galaxy</p> 3335</blockquote> 3336 3337<p><a href=downloads/toybox-0.4.6.tar.bz2>Toybox 0.4.6</a> is based on 3338<a href=http://landley.net/hg/toybox/shortlog/1068>commit 1068</a>.</p> 3339 3340<p>This release adds 3341several new commands: Felix Janda wrote paste and fallocate, Kyungwan Han 3342submitted eject, Strake contributed grep, Ashwini Sharma added pmap (and 3343a testsuite entry for grep), Lukasz Skalski sent pwdx, Isaac Dunham posted 3344acpi, and I did timeout and umount.</p> 3345 3346<p>The ls command now has a --color=auto option (suggested by Rich Felker). 3347The multiplexer now has a --help option so you can say "./toybox --help blah" 3348instead of using the built-in "help" command. (Which is a shell built-in. 3349Try it on your command line, it's like man for shell builtins. But a certain 3350other project has conditioned people to expect --help, so...) I forget who 3351heehooman at gmail is but they pointed out unshare needed PID and UID 3352namespace support.</p> 3353 3354<h3>Pending</h3> 3355 3356<p>A lot of new commands in toys/pending, to the point the next release should 3357probably just focus on cleanup and review of this backlog. We've got klogd, 3358dhcp, dhcpd, watch, route, and ps from 3359Ashwini Sharma (and an fsck wrapper but no fsck.fstype engines yet), 3360syslogd, pgrep, and pkill from Madhur Verma, netstat by Ranjan Kumar, 3361test by Felix Janda, lspci by Isaac Dunham, nl, su, and renice by strake (I.E. 3362M. Farkas-Dyck), and sysvinit by Kyungwan Han.</p> 3363 3364<p>Some cleanup work on existing pending commands that aren't 3365ready to promote yet: I did a few more rounds on ifconfig 3366and Isaac Dunham's did several cleanups to xzcat, Felix Janda cleaned up 3367logger and syslogd...</p> 3368 3369<p>Also some cleanup work on commands that predate the pending directory, 3370but weren't quite polished when they went in, most prominently du, 3371expand, and touch.</p> 3372 3373<h3>Infrastructure</h3> 3374 3375<p>The new scripts/single.sh builds a standalone command without the 3376multiplexer, although not all commands can be built that way yet (NEWTOY yes, 3377OLDTOY no) and the space savings aren't anything to write home about. (If a 3378command needs the option parsing logic at all, it needs all of it.) If 3379you're curious, you can do:</p> 3380 3381<blockquote><pre> 3382make defconfig 3383make 3384mkdir singles 3385for i in $(./toybox) 3386do 3387 echo $i 3388 PREFIX=singles/ scripts/single.sh $i || break 3389done 3390</pre> 3391<p>(And then wait a long time and watch almost half the builds fail.)</p> 3392</blockquote> 3393 3394<p>There is now libbuf analogous to toybuf, another global 4k buffer this 3395time for use by lib/ code instead of command code.</p> 3396 3397<p>The lib directory got split up a bit, lib/pending.c contains functions 3398not yet used by anything outside of toys/pending/*, and lib/xwrap.c contains 3399functions that wrap other functions and handle failures (via error_exit). 3400This leaves lib/lib.c containing actual new functions.</p> 3401 3402<p>General improvements and bug fixes to argument parsing. The [-abc] exclude 3403logic should now clear arguments slots when disabling options. Bare --longopts 3404should work now and be able to report errors using their name, the new ; 3405option allows optional arguments to longopts only suppliable with = (I.E. 3406--color and --color=auto but not --color auto).</p> 3407 3408<p>I'm gradually weaning the code off of itoa()/utoa() because sprintf 3409does this already. In this case "simple" probably means "let libc do it 3410for us".</p> 3411 3412<p>Rewrote for_each_pid_with_name_in() and renamed it to just names_to_pid(). 3413It shouldn't get confused trying to compare absolute and relative paths quite 3414so much anymore.</p> 3415 3416<p>lib/llist.c grew a new dlist_pop() function for removing a doubly 3417linked list entry while maintaining a circular list; tail and patch are 3418using it now.</p> 3419 3420<p>The musl guys suggested a new optimization flag 3421(-fno-asynchronous-unwind-tables) 3422that shaves about 10% off the binary size by removing a C++ism that crept 3423into gcc's idea of C. While I don't normally try to micromanage the compiler, 3424"-fstop-being-stupid" is a thing you have to hit gcc with from time to time.</p> 3425 3426<h3>Bugfixes</h3> 3427 3428<p>Felix Janda and I did a largeish rewrite of tail to 3429finally make it work right (we think). Still need to implement tail -f 3430someday (the tricky bit is making -f follow multiple files at once). 3431Felix also reported a bug in xpidfile.</p> 3432 3433<p>Juhani Haverinen pointed out that 3434python 3 doesn't work with config2help.py, so the detection logic looks 3435for python2 (until I get around to rewriting that in C). Elie De Brauwer 3436then fixed our first attempt at this, and also fixed uname's help string.</p> 3437 3438<p>Ashwini Sharma 3439pointed out the build was making a FLAG_ macro for " " which broke some 3440configurations. (That's a control character, not a command line option.)</p> 3441 3442<p>Jacek Bukarewicz pointed out a bug in chdir permission handling, and 3443a way to make env segfault. Both should be fixed now.</p> 3444 3445<p>The new function xexec_optargs() 3446replaces calls to xexec(toys.optargs) to avoid freeing and reusing optargs 3447during option parsing screwing stuff up (such as netcat's exec mode).</p> 3448 3449<p>The stat command's %a output was padded with leading zeroes, which 3450didn't match anybody else's behavior and thus made the test suite hiccup 3451between TEST_HOST and testing toybox. (If you go "TEST_HOST=1 scripts/test.sh 3452command" it sanity checks the tests against the host implementation.)</p> 3453 3454<p>Last release, "mkdir sub/sub && chmod 007 sub/sub && rm -rf sub" didn't 3455delete sub and didn't exit with an error either. Neither was correct, rm 3456should now be fixed.</p> 3457 3458<p> 3459<a name="26-07-2013" /><a href="#26-07-2013"><hr><h2><b>July 26, 2013</b></h2></a> 3460<p>Georgi Chorbadzhiyski maintains a <a href=https://github.com/gfto/toybox>git 3461mirror</a> of the repository on github, automatically updated from the 3462mercurial every 6 hours. The mirror is read only, but you can generate patches 3463against it and post them to the list.</p> 3464 3465<a name="02-07-2013" /><a href="#02-07-2013"><hr><h2><b>July 2, 2013</b></h2></a> 3466<blockquote><p>"Time is an illusion. Lunchtime doubly so." "Very deep. You 3467should send that in to the Reader's Digest. They've got a page for people 3468like you."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3469 3470<p><a href=downloads/toybox-0.4.5.tar.bz2>Toybox 0.4.5</a> is based on 3471<a href=http://landley.net/hg/toybox/shortlog/941>commit 941</a>. It adds 3472uuencode and uudecode from Erich Plondke, and enables Luis Morales' "who" by 3473default. Felix Janda and I cleaned up last year's "stat" submission and 3474enabled it. Ivo van Poorten added "groups". 3475Andre Renaud added "lsusb". I implemented "split", "pivot_root", and "mv". 3476</p> 3477 3478<p>The "help" command is implemented differently now (lib/help.c) and 3479each command can now understand --help (including both "toybox --help" 3480and "toybox --help command" in the multiplexer).</p> 3481 3482<p>The "pending" directory has several commands (find, xzcat, nbd-client, 3483logger, expr) which work but are not enabled by default pending further cleanup. 3484Ifconfig is enabled, but still in pending because it's only 2/3 cleaned up. 3485(It's an awkward halfway state but I'm not holding up the release for it.)</p> 3486 3487<p>I'm <a href=cleanup.html>documenting the cleanups</a> to teach 3488more people to do it, but the writeups aren't caught up yet. The 3489<a href=roadmap.html>roadmap</a> also got updated a bit with further analysis 3490of other projects, and the README and about pages got updated.</p> 3491 3492<p>Fixed _another_ "ls -C" segfault when terminal size can't be detected, 3493condensed the ls help text to fit on one page, implented --color, and taught 3494-l to print the major, minor numbers when showing block/char devices. 3495Argument parsing now handles "--" properly (to end option checking), 3496and the infrastructure can now handle bare --longopts that have no 3497corresponding short option (both were implemented before but didn't work). 3498Fixed an old bug in "patch", chmod grew -f, who grew -a. Isaac Dunham 3499fixed "-" vs "_" handling in modinfo, added a "firmware" output 3500field, added -b and -k support, and taught it that the ".ko" extension means 3501to look for the file at the specified path instead of under /lib. Felix Janda 3502moved file permission display code to lib so ls and 3503stat could share it. Ashwini Sharma spotted a bug in xabspath when the 3504last path component exists but we haven't got permissions to open it 3505(ala readlink -f /dev/sda as a normal user). 3506</p> 3507 3508<p>In the build infrastructure, scripts/findglobals.sh finds leaked global 3509variables. (Leaked means they aren't part of the global union: Other than glibc 3510debris, toybox should define "this", "toy_list", "toybuf", and "toys", and 3511that's it; the rest add memory footprint to every command for the benefit of 3512just one command; use GLOBALS() to stick 'em in the union.) Static linking 3513against libraries other than the host's libc now applies to feature probes 3514for unshare and such. Neuter stupid internationalization support that makes 3515various host "sort" commands put things in an order other than alphabetical 3516(breaking the multiplexer's binary search on command names). 3517 3518<p>You should now be able to build from a source control snapshot on a build 3519system that hasn't got python: if you disable CONFIG_TOYBOX_HELP. (The 3520release tarballs ship generated/help.h, but it's not in source control. 3521Eventually I should rewrite that python script in C.)</p> 3522</p> 3523 3524<p><b>LICENSE TWEAK</b>: After <a href=http://lists.landley.net/pipermail/toybox-landley.net/2013-March/000794.html>discussion</a> on the mailing list the "2 clause 3525BSD" <a href=license.html>license</a> got slightly simplified so the first 3526paragraph now says:</p> 3527 3528<blockquote><p>Permission to use, copy, modify, and/or distribute this 3529software for any purpose with or without fee is hereby granted.</p></blockquote> 3530 3531<p>It used to continue "provided that the above copyright notice and this 3532permission notice appear in all copies", but A) what's the point? B) does "all 3533copies" mean binaries, or just source code, or what? C) lots of projects 3534that consider BSD and GPL compatible have <a href=https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/crypto/aes_generic.c>files with 3535both license notices</a> on them (sometimes at <a href=http://git.busybox.net/busybox/tree/shell/ash.c>opposite ends of the file</a> to make the conflict 3536less obvious) because "all copies must include this function" would violate 3537the GPL but "all copies must include this magic text blob" somehow don't?</p> 3538 3539<p>I don't want to have to care about this anymore. The tweaked version is more 3540or less public domain with a liability disclaimer, but we're still calling it 3541BSD (sometimes "0 clause BSD") to avoid explaining.</p> 3542 3543<a name="21-03-2013" /><a href="#21-03-2013"><hr><h2><b>March 21, 2013</b></h2></a> 3544<p>Video of my ELC talk 3545"<a href=http://youtu.be/SGmtP5Lg_t0>Why is Toybox?</a>" 3546is up on youtube. Related materials include the 3547<a href=http://landley.net/talks/celf-2013.txt>talk outline</a> and an 3548<a href=/aboriginal/about.html#selfhost>android self-hosting writeup</a>.</p> 3549 3550<p>[Updated June 4] The following links jump to specific topics in the video. (Sorry about 3551the ads, it's The Linux Foundation.)</p> 3552 3553<ul> 3554<li>0m29s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=0m29s>The smartphone is replacing the PC</a></li> 3555 <ul> 3556 <li>4m22s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=4m22s>Software needed to become self-hosting</a></li> 3557 <li>6m20s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=6m20s>Do we care if android or iphone wins?</a></li> 3558 </ul> 3559<li>9m45s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=9m45s>Android not vanilla: oppose or accept?</a></li> 3560 <ul> 3561 <li>11m30s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=11m30s>Open source can't do User Interfaces</a></li> 3562 </ul> 3563<li>15m09s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=15m09s>Android is not copyleft: oppose or accept?</a></li> 3564<li>18m23s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=18m23s>Security issues</a></li> 3565<li>21m15s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=21m15s>Solutions to the software problems</a></li> 3566 <ul> 3567 <li>22m55s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=22m55s>What toybox needs to be/do</a></li> 3568 <li>28m17s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=28m17s>What is toybox?</a></li> 3569 <ul> 3570 <li>28m58s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=28m58s>Why toybox started...</a></li> 3571 <li>37m50s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=37m50s>What does toybox actually implement?</a></li> 3572 </ul> 3573 </ul> 3574</ul> 3575</span> 3576 3577 3578<a name="14-03-2013" /><a href="#14-03-2013"><hr><h2><b>March 14, 2013</b></h2></a> 3579<blockquote><p>"Ford, you're turning into a penguin. Stop it." - 3580</p><p>The Hitchhiker's Guide to the Galaxy</p></blockquote> 3581 3582<p><a href=downloads/toybox-0.4.4.tar.bz2>Toybox 0.4.4</a> is based on 3583<a href=http://landley.net/hg/toybox/shortlog/813>commit 813</a>, adding 3584the "time" and "readahead" commands, plus some bugfixes.</p> 3585 3586<p>The "cp" command now implements the -s symlink option, plus bugfixes 3587getting various corner cases right as used in actual package builds. 3588"id -Gn root" should now print root's groups 3589instead of the current user's. Several build fixes so toybox builds under 3590Ubuntu 8.04 again (which is about as old a build environment as you 3591can expect to find posix-2008 features in).</p> 3592 3593<p>Unfinished commands have generally been moved to "toys/pending". 3594Everything else should "default y" to participate in make defconfig. 3595Several of those pending commands got some basic cleanup so allyesconfig 3596should at least compile (although defconfig is still what's useful).</p> 3597 3598<p>Significant roadmap updates, checking several other multicall binaries 3599(klibc, sash, sbase, s6...) to see what commands they include.</p> 3600 3601<a name="18-01-2013" /><a href="#18-01-2013"><hr><h2><b>January 18, 2013</b></h2></a> 3602<blockquote><p>This must be Thursday. I never could get the hang of Thursdays.</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3603 3604<p><a href=downloads/toybox-0.4.3.tar.bz2>Toybox 0.4.3</a> is based on 3605<a href=http://landley.net/hg/toybox/shortlog/793>commit 793</a>. There 3606are now exactly 100 commands in defconfig (of a little over 220 on the 3607<a href=roadmap.html>todo list</a>).</p> 3608 3609<p>Elie De Brauwer added the rev command, cleaned up tac, implemented the -s 3610and -f flags for seq, added -v and -i to killall (and fixed killall not to 3611kill itself before finishing its pid list), and added to the test suite. 3612Felix Janda added -m to mkdir, pwd -L and -P, and more test suite entries.</p> 3613 3614<p>Rob Landley added the losetup command, and fixed the existing ls, cp, and 3615readlink commands. The segfault in ls 3616happened when it couldn't determine the screen size (last release changed the 3617default to -C and a screen size of 0 made column view unhappy), and cp got an 3618extensive rewrite bringing it up to date with the dirtree changes and fixing 3619a number of things it never did right in the first place. The xabspath() 3620code in the library now handles a symlink after ".." properly (and the test 3621suite checks for it).</p> 3622 3623<p>Infrastructure-wise the code is better about automatically setting the 3624error return code properly. Now error_msg() sets the exit code to 1 if it's 3625still defaulting to 0, and the global exit path does a fflush(NULL) with error 3626bit check rather than trying to be quite so granular about flushing. (That 3627means if we use printf() instead of xprintf() it still exits with the right 3628error code, it just doesn't end the program early on an output error.) 3629Minor bugfix so TOYBOX_DEBUG 3630doesn't always warn about the lack of suid bit when toybox is built with 3631at least one STAYROOT command. Bugfix for the option [grouping] logic 3632(and then further fixes to the error reporting pointed out by Ashwini Sharma). 3633dirtree_handle_callback() now has a prefix like the rest of the dirtree 3634functions. A lot of stuff doing manual path handling was switched to using 3635libc basename() (including, embarassingly, the basename command), which means 3636it now correctly detects "/trailing/slash/" which the previous code didn't.</p> 3637 3638<p>Also, last release included some accidentally checked in debug code that 3639disabled compiler optimization, so the binary size bloated a bit. It's back 3640to -Os by default now.</p> 3641 3642<a name="15-12-2012" /><a href="#15-12-2012"><hr><h2><b>December 15, 2012</b></h2></a> 3643<blockquote><p>"The major difference between a thing that might go wrong and a 3644thing that cannot possibly go wrong is that when a thing that cannot possibly 3645go wrong goes wrong it usually turns out to be impossible to get at or repair." 3646</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3647 3648<p><a href=downloads/toybox-0.4.2.tar.bz2>Toybox 0.4.2</a> is based on 3649<a href=http://landley.net/hg/toybox/shortlog/749>commit 749</a> and is 3650just a resync. Linux 3.7 came out, meaning it's time to do an Aboriginal 3651Linux release, and that should use a stable version of toybox. So here's 3652a new stable version.</p> 3653 3654<p>The new commands are cut (from Jason Kyungwan Han), touch 3655(from Choubey Ji), expand (from Jonathan Clairembault, and he fixed a 3656bug in login), and rm (from Rob Landley). Felix Janda added UTF-8 3657support infrastructure (for non-ascii character sets) with a config option. 3658Elie De Brauwer added tests for cat and sha1sum, and -so options to pidof. 3659The "ls" command defaults to -C (column view) now, and "readlink" now supports 3660-fenq.</p> 3661 3662<p>Portability work: toybox should now build against the musl C library, 3663and against older glibc versions (circa 2008, much before that and kernel 3664features we depend on start to drop out).</p> 3665 3666<p>The whole codebase got reindented from "one tab" to "two spaces" per 3667level. The option parsing logic now understands [groups] of commands (when more 3668than one in a group is selected it can switch the others off, or error out, 3669or other things). The error_exit() infrastructure can now longjmp back to an 3670earlier point instead of exiting. Each toys/* directory now has a README, 3671the first line of which is the fancy name menuconfig uses for the directory 3672(so no more hardwired directory list in scripts/genconfig.sh).</p> 3673 3674<p>Fixed a filehandle leak in getmountlist(). 3675Pass parent pointer to dirtree_add_node() so it can give error messages with 3676full path. The yesno() function now always reads from stdin and writes to 3677stderr (we can retry tty checking complexity once we've got commands needing 3678it).</p> 3679 3680<p>The open group broke their website so the 3681<a href=http://opengroup.org/onlinepubs/9699919799>old links</a> to POSIX 2008 3682now <a href=http://pubs.opengroup.org/onlinepubs/9699919799>need to start with 3683pubs</a>. Some of the links in the tree have been updated, others haven't while 3684I wait to see if their webmaster notices and fixes it.</p> 3685 3686<p>(I note that the current rm implementation is not technically posix compliant 3687because the standard requires infinite recursion depth and the current 3688implementation uses one filehandle per level. I can add a config option 3689to do it Posix's way, which is more brittle and needs extra security checks, 3690but am waiting for somebody to complain first. The default "ulimit -n" is 1024 3691filehandles, so drilling down over 1000 nested subdirectories).</p> 3692 3693<a name="13-11-2012" /><a href="#13-11-2012"><hr><h2><b>November 13, 2012</b></h2></a> 3694<blockquote><p>"Rule Six: The winning team shall be the first team that wins." 3695</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3696 3697<p><a href=downloads/toybox-0.4.1.tar.bz2>Toybox 0.4.1</a> is based on 3698<a href=http://landley.net/hg/toybox/shortlog/691>commit 691</a>.</p> 3699 3700<p>Elie De Brauwer contributed usleep, Ashwini Kumar contributed du, and 3701Kyungwan Han contributed vconfig. Other new commands include switch_root and 3702md5sum, and the remaining shell wrappers are now proper commands (dos2unix, 3703unix2dos).</p> 3704 3705<p>The patch command now supports -l, and gethostname is now enabled by 3706default. The df command follows symlinks to get the actual device name. 3707Felix Janda added -m support to wc (for utf8).</p> 3708 3709<p>On the infrastructure side, the commands have now been grouped into 3710"posix", "lsb", and "other" subdirectories (for things required by Posix-2008, 3711the Linux Standard Base 4.1, and commands in neither). This affects menuconfig 3712and the actual source layout (toys/cp.c is now toys/posix/cp.c, and so on). 3713An android directory is planned (see the updated 3714<a href=roadmap.html#android>android roadmap analysis</a>).</p> 3715 3716<p>The FLAG_ macros for command option parsing and TT alias for the command's 3717global block are now automatically generated, commands should 3718#define FOR_commandname before #including <toys.h> to get the macros for that 3719command.</p> 3720 3721<p>An upgrade to the build infrastructure now allows commands with _ and - 3722in them, such as switch_root.</p> 3723 3724<p>Bugfixes: Avery Pennarun spotted a case where ls showed uid twice instead of 3725uid and gid, and that nice was using the wrong range of numbers. 3726The ls command also recursed inappropriately last time (not quite 3727properly converted for the dirtree changes last release), and now it's 3728fixed. Roy Tam pointed out a glitch in sh, and fixed df's percentage 3729calculation to match the POSIX spec. The kernel build didn't like our mktemp 3730and it does now. The wc command wasn't quite posix compliant (trailing spaces 3731break stuff). The ls command recursed inappropriately last time (not quite 3732properly converted for the dirtree changes last release), and now it's 3733fixed. The catv command wasn't displaying byte 255 correctly. Some lib 3734fixes (thinko in xpidfile). Fixed uname -m when running a 32 bit x86 binary 3735on an x86-64 host (it lies and says the system is i686, i586, or i486 depending 3736on what the toolchain that built the binary supported. This makes builds in 3737a 32 bit chroot on a 64 bit kernel break less.) The df command was checking 3738partitions in the wrong order (displaying undermounts instead of overmounts: 3739this used to work but some library code changed out from under it and it 3740wasn't updated to match until now). Felix Janda filled out the test suite 3741some more. The patch file creation logic got tweaked several times to 3742successfully apply more patches. Support for older (pre 2.10) glibc 3743versions was added to portability.h.</p> 3744 3745<p>Miscelaneous cleanups all around (mknod, sha1sum, logname), including a 3746rewrite of taskset to be less dependent on libc getting the headers right. All 3747the command headers should now point to the current relevant standards 3748document, where applicable.</p> 3749 3750<p>This news page had old news entries from before the relaunch moved into 3751a separate <a href=oldnews.html>oldnews</a> page.</p> 3752 3753<p>I forgot to create <a href=bin>static binaries</a> last time, but they're 3754back now.</p> 3755</span> 3756 3757<a name="23-07-2012" /><a href="#23-07-2012"><hr><h2><b>July 23, 2012</b></h2></a> 3758<blockquote><p>"Ford", Arthur said. "There's an infinite number of monkeys 3759out here who want to talk to us about this script for Hamlet they've worked 3760out."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3761 3762<p><a href=downloads/toybox-0.4.0.tar.bz2>Toybox 0.4.0</a> is based on 3763<a href=http://landley.net/hg/toybox/shortlog/640>commit 640</a>.</p> 3764 3765<p>The new <a href=status.html>status page</a> is calculated from 3766the roadmap info, and should be easier to keep up to date in future.</p> 3767 3768<p>Andre Renaud contributed od and modinfo. Elie De Brauwer contributed 3769taskset, bugfixes to cmp and tail, and tests for sort and tail. Kyungwan Han 3770contributed passwd. Gaurang Shastri contributed w. Ashwini Sharma spotted a 3771case where dirtree was adding extra slashes to a path.</p> 3772 3773<p>I rewrote od, cleaned up comm, documented the 3774<a href=code.html#lib_llist>llist</a> and 3775<a href=code.html#lib_dirtree>dirtree</a> infrastructure, added an -r option 3776to date (and fixed a bug where -u wouldn't override /etc/localtime), 3777fixed bugs in chmod +stw, fixed ls to show suid bits properly when the 3778corresponding executable bit wasn't set, and worked around a longstanding 3779glibc bug where static linking prevents stdout from automatically flushing 3780pending output on exit.</p> 3781 3782<a name="25-06-2012" /><a href="#25-06-2012"><hr><h2><b>June 25, 2012</b></h2></a> 3783<blockquote><p>"For a moment, nothing happened. Then, after a second or so, nothing continued to happen."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3784 3785<p><a href=downloads/toybox-0.3.1.tar.bz2>Toybox 0.3.1</a> is based on commit 3786<a href=http://landley.net/hg/toybox/shortlog/607>commit 607</a>. It's 3787mostly a bugfix release for ls -l (which was unhappy on targets other than 3788x86-64), plus a new "date" from Andre Renaud and rewritten chgrp/chown which 3789now support the full set of posix flags, plus a little work on the test 3790suite and some more header tweaks towards eventual compatability with the 3791musl libc.</p> 3792 3793<p>The todo list runneth over, but "release early, release often", so here 3794it is. The roadmap and documentation are a bit behind, and I've got ~40 3795pending submissions to review. I need to catch up...</p> 3796</span> 3797 3798<a name="12-06-2012" /><a href="#12-06-2012"><hr><h2><b>June 12, 2012</b></h2></a> 3799<blockquote><p>"For instance, on the planet Earth, man had always assumed that 3800he was more intelligent than dolphins because he had achieved so much - the 3801wheel, New York, wars and so on - whilst all the dolphins had ever done was 3802muck about in the water having a good time. But conversely, the dolphins had 3803always believed that they were far more intelligent than man - for precisely 3804the same reasons."</p><p>- The Hitchhiker's Guide to the Galaxy</p></blockquote> 3805 3806<p>It's well past time for <a href=downloads/toybox-0.3.0.tar.bz2>toybox 0.3.0</a>, 3807so here it is, based 3808on <a href=http://landley.net/hg/toybox/shortlog/595>commit 595</a>, and the 3809statically linked <a href=downloads/binaries>prebuilt binaries</a> should 3810actually be statically linked this time (thanks Ashwini Sharma for spotting 3811that).</p> 3812 3813<p>It's hard to figure out where to cut a release, because development 3814doesn't stop. "Long before now" is the obviuos answer, of course. 3815The project's maintainer also moved house during this development cycle, which 3816threw things off for a bit (so many boxes). Releases should hopefully be a bit 3817more frequent from here on.</p> 3818 3819<p>The big things Rob worked on this time were the new dirtree (directory 3820tree traversal) infrastructure, and a complete rewrite of ls using that 3821which should now implement all 26 posix options.</p> 3822 3823<p>Georgi Chorbadzhiyski added printenv, whoami, mkdir, mkfifo, chmod, chown, 3824chgrp, and uniq. He also added fraction and extension support to sleep (so if 3825you need a quarter-second sleep, it can do that now), and fixed a build bug 3826on slackware.</p> 3827 3828<p>Daniel Walter contributed a string to mode_t parser (in use by chmod and 3829mkdir -m). Ilya Kuzmich contributed comm. Elie De Brauwer added mountpoint, 3830vmstat, logname, login, and mktemp. Kevin Chase did some portability cleanups. 3831Pere Orga fixed some documentation.</p> 3832 3833<p>The "tac" and "clear" commands are now normal commands instead of shell 3834wrappers, and the header #includes have been cleaned up a bit to remove 3835deprecated functions and attempt to increase compatability with the bionic and 3836musl C libraries, "tail" should now use lseek() for large files, and "id" got 3837some cleanups and bugfixes.</p> 3838 3839<p>The new TOYBOX_FLOAT configuration option selects whether or not 3840to include floating point support (for embedded targets where that's 3841problematic).</p> 3842 3843<p>Several random bugfixes: unshare() might actually build portably now, 3844yes 'n' | cp -i should no longer bypass stdin and prompt via the tty, the 3845SUID support no longer drops permissions going through the toybox 3846multiplexer command, and a bugfix to xargs -0 means it should no longer 3847segfault. (I have a pending bug report about xargs not doing the full 3848posix whitespace handling that -0 obsoleted, but I'll deal with that next 3849release.)</p> 3850 3851<p>The build infrastructure is now automatically generating FLAG_ macros 3852for the options, but currently with the wrong names. Some more macro glue 3853is necessary, which I haven't quite figured out how to do yet.</p> 3854 3855<p>A defconfig toybox at the start of the $PATH has successfully built 3856Linux From Scratch (in my Aboriginal Linux project). The commands that 3857'default n' in the config are often still broken, cleanup is ongoing. 3858(The new dirtree stuff broke several of them that haven't been converted 3859yet, but if I wait until everything works we won't have a release before 38601.0, so here's a checkpoint.)</p> 3861 3862 3863<a name="03-03-2012" /><a href="#03-03-2012"><hr><h2><b>March 3, 2012</b></h2></a> 3864 3865<blockquote><p>"They went unnoticed at Goonhilly, passed over Cape Canaveral 3866without a blip, and Woomera and Jodrell Bank looked straight through them. 3867Which was a pity, because it was exactly the sort of thing they'd been looking 3868for all these years."</p><p>- The Hitchhiker's Guide to the Galaxy</p> 3869</p></blockquote> 3870 3871<p>Here's <a href=downloads/toybox-0.2.1.tar.bz2>toybox 0.2.1</a> based 3872on <a href=http://landley.net/hg/toybox/shortlog/512>commit 512</a>. This 3873time around, there are statically linked <a href=downloads/binaries>prebuilt 3874binaries</a> for various embedded targets.</p> 3875 3876<p>It's been a busy few weeks, almost entirely due to new contributors. (I 3877have not quite been keeping up.)</p> 3878 3879<p>Elie De Brauwer contributed free, uptime, swapon, swapoff, lsmod, mknod, 3880insmod, rmmod, and fixed a bug in basename. Andre Renaud contributed ls, ln, 3881realpath, and hostname. Andres Heck contributed pidof and killall. Daniel 3882Walter wrote kill and extended id. Timothy Elliott contributed tail and tests 3883for cmp. Frank Bergmann sent a warning fix. Bryce Fricke added -i to cp. 3884Nathan McSween pointed out an optimization. Georgi Chorbadzhiyski fixed 3885cross compiling to work more reliably.</p> 3886 3887<p>(My own contribution this time around was just tightening up other people's 3888code, a build fix to unshare, some random bugfixes, and so on. My only new 3889code this time around was writing a bash replacement for the existing python 3890bloat-o-meter.)</p> 3891 3892<p>Last time (the 0.2.0 release) included the first pass at an id command from 3893Tim Bird, env and basename from Tryn Mirell, cmp and head from Timothy Elliott, 3894more bugfixes from Nathan McSween and Elie De Brauwer, and Luis Felipe Strano 3895Moraes did a first pass at the who command plus other bugfixes and 3896optimizations.</p> 3897 3898<p>(For that release I did xargs, cal, truncate, unlink, nohup, tty, wc, link, 3899dirname, unshare, and various infrastructure tweaks, but it took me 3 months 3900and those guys did their stuff in a week or so.)</p> 3901 3902 3903<a name="12-02-2012" /><a href="#12-02-2012"><hr><h2><b>February 12, 2012</b></h2></a> 3904<blockquote><p> 3905"for though it has many omissions and contains much that is apocryphal, or at 3906least wildly inaccurate, it scores over the older, more pedestrian work in two 3907important respects..."</p> 3908<p> - The Hitchhiker's Guide to the Galaxy</p></blockquote> 3909 3910<p>Here's the first BSD licensed release, 3911<a href=downloads/toybox-0.2.0.tar.bz2>toybox-0.2.0</a>, more a synchronization 3912point than anything particularly useful. 47 commands in a reasonably 3913ready-to-use state (what "make defconfig" builds), another ten or so partially 3914finished stubs ("make allyesconfig"), and several 3915patches pending on the mailing list I need to review and merge.</p> 3916 3917<p>More to come...</p> 3918 3919<hr> 3920<a name="15-11-2011" /><a href="#15-11-2011"><hr><h2><b>November 15, 2011</b></h2></a> 3921- Back from the dead, Toybox is now under a 2 3922clause BSD license, and aiming to become the default command line 3923implementation of Android systems everywhere.</p> 3924 3925<p>More to come...</p> 3926 3927<hr> 3928 3929<p><a href=oldnews.html>Old news</a> from before the relaunch.</p> 3930 3931<!--#include file="footer.html" --> 3932