Tag Archives: unix

Ghost in the Shell – Part 4

Long time no see. Its been a while since last post in the Ghost in the Shell series. Its also exactly one full year since I started this blog – from the first Ghost in the Shell series article – the Part 1 – that was published on 2018/03/15 day.

Today I would like to show you new pack of useful tricks and features for productive terminal/shell use. Lets start with something simple yet useful.

You may want to check other articles in the Ghost in the Shell series on the Ghost in the Shell – Global Page where you will find links to all episodes of the series along with table of contents for each episodeโ€™s contents.

Named Pipes

We all (or at least most :>) know and love pipes in UNIX. For the record – ls | grep match | awk '{print $3}' | sed 's/.jpg//g' – command ‘chains’ like that one ๐Ÿ™‚

What is a named pipe then? A manually defined pipe for special purposes. For example some applications – especially the so called Enterprise ones – often do not support UNIX pipes mechanisms – they only can dump something to a file. A great example of such Enterprise software is Oracle database whose dump command can only make dump to a file. With tool that supports UNIX pipes you would probably want to pipe that data to gzip(1)/xz(1) to compress it on the fly or even pipe it directly to ssh(1) to the Backup server for example, but not with Oracle.

This is where named pipes feature helps. We will create named pipe called /tmp/PIPE so Oracle’s dump command will be able to use it and on the other side of this pipe we will attach a pipe to gzip -9 command to compress that data on the fly.

Below example is from Linux system so mknod(1) command will be used. For example on FreeBSD you would use mkfifo(1) command for named pipe. Complete example of such named pipe is presented below.

root # cd /tmp
root # mknod /tmp/PIPE p
root # chown oracle:oinstall /tmp/PIPE
root # dd if=/tmp/PIPE bs=1M | gzip -9 > /mnt/oracle/oracle-database-backup.dmp.gz &

Now the /tmp/PIPE named pipe is ready to be used. When any process will start to write something to the /tmp/PIPE named pipe it will be automatically grabbed by dd(8) command and piped to the gzip(1) command that will compress that input and write it into the /mnt/oracle/oracle-database-backup.dmp.gz file.

Now we can start the Oracle dumping process with dump command.

root # su - oracle
oracle % dump file=/tmp/PIPE

When the dump command finishes its work you will find all your dumped data compressed in the /mnt/oracle/oracle-database-backup.dmp.gz file.

Other example of named pipes usage is my desktop dzen2 setup with unusual update schedule – described in detail in the FreeBSD Desktop – Part 13 – Configuration – Dzen2 article.

Modify Command Environment on the Fly

For most of the time we use export(1) builtin to export needed environment values that our command needs. You can then check what environment exported values are with the env(1) command of course … but you can use the same env(1) command to run any command with modified environment without exporting variables using export(1).

Here is brief example of this feature.

For the record – the gls(1) command is a GNU/Linux ls(1) command from sysutils/coreutils package/port but to make it work without name conflicts on FreeBSD where BSD ls(1) is also present it had to be renamed to gls(1).

% gls -l | head -1
total 8609K

% env LC_ALL=pl_PL.UTF-8 gls -l | head -1
razem 8609K

In the example above we run gls(1) command with default environment – I use en_US.UTF-8 locale daily. The second invocation with LC_ALL=pl_PL.UTF-8 modified environment made gls(1) command display its output in Polish (pl_PL.UTF-8) language. The word ‘razem‘ means ‘total‘ in Polish.

Other useful example may be using make(1) to build FreeBSD port with known vulnerabilities. By default FreeBSD’s build(7) system will not allow us to build such port (and that is good defaults) but if we know what we are doing we will use following spell.

# env DISABLE_VULNERABILITIES=yes make -C /usr/ports/security/bdes/ build install clean

Its also useful with commands that do not play well with UTF-8 input like tr(1) for example. When LC_ALL is set to en_US.UTF-8 it will throw an error upon as.

% tr -cd '0-9' < /dev/random | head -c 16
tr: Illegal byte sequence
%

We just wanted to generate random 16 numbers.

To make it work we will modify the LC_ALL environment for this invocation.

% env LC_ALL=C tr -cd '0-9' < /dev/random | head -c 16
9571949869123855
%

Much better ๐Ÿ™‚

Other example with timezones using date(1) command and TZ variable as shown in the example below.

% date
Fri Mar 15 14:03:38 CET 2019

% env TZ=Australia/Darwin date 
Fri Mar 15 22:35:26 ACST 2019

The Real Path

The symlinks with ln(1) are very useful for many ways, to organize stuff, for quick fixes, for versioning … you will find tons of other use cases.

There is just one problem, if you make to many levels or symlinks or its just too much nested you do not know where you are anymore … this is where the realpath(1) comes handy. No matter how many levels of links you have made, it will tell you the truth – what is the current real path. The pwd(1) command will not help you here thou.

Here is a short example how it works.

% pwd
/home/vermaden
% ln -s /home/vermaden ASD
% cd ASD
% pwd
/home/vermaden/ASD
% realpath
/home/vermaden

Browsing the PATH

Many times I wanted to ‘browse’ through the PATH to search for something. As you possibly know the PATH variable stores paths that are colon (:) separated.

You can redefine the IFS variable which by default contains space ‘ ‘ which will work as field delimited for the for loop.

Here is the example.

% export IFS=":"

% for I in $( echo ${PATH} ); do echo ${I}; done
/sbin
/bin
/usr/sbin
/usr/bin
/usr/local/sbin
/usr/local/bin 

% for I in $( echo ${PATH} ); do find ${I} -name ifconfig; done
/sbin/ifconfig

The other way to do this is to use plain old tr tool to translate colons (:) into newlines (\n) so we will be able to use the while loop here.

Here is the tr(1) example.

% echo ${PATH} | tr ':' '\n' | while read I; do echo ${I}; done
/sbin
/bin
/usr/sbin
/usr/bin
/usr/local/sbin
/usr/local/bin

% echo ${PATH} | tr ':' '\n' | while read I; do find ${I} -name dd; done
/bin/dd

You can also achieve same thing using the Parameter Expansion in which we will change the colons (:) into newlines (\n) as shown in the example below.

% echo "${PATH//:/\n}"
/sbin
/bin
/usr/sbin
/usr/bin
/usr/local/sbin
/usr/local/bin

# echo "${PATH//:/\n}" | while read I; do find ${I} -name camcontrol; done
/sbin/camcontrol

Parameter Expansion

I will not show all possible Parameter Expansion methods – just the most useful ones.

The typical use is to get the extension of a file or to ’emulate’ basename(1) or dirname(1) commands – it will be faster to use Parameter Expansion instead of invoking these commands each time. Below are two tables showing what you will get from which Parameter Expansion method.

PARAMETER    RESULT                       DESC 
-----------  ---------------------------  --------------
${name}      kubica.polish.racing.legend  content
${name#*.}          polish.racing.legend  -
${name##*.}                       legend  extension
${name%%.*}  kubica                       -
${name%.*}   kubica.polish.racing         -

… and with slash (/) character.

PARAMETER    RESULT                       DESC 
-----------  ---------------------------  --------------
${name}      kubica/polish/racing/legend  content
${name#*/}          polish/racing/legend  -
${name##*/}                       legend  basename(1)
${name%%.*}  kubica                       root directory
${name%/*}   kubica/polish/racing         dirname(1)

You can also use Parameter Expansion methods to grab the protocol from an URL like shown below.

% URL="https://vermaden.wordpress.com"

% echo "${URL%%/*}"
https:

Sort Human Readable Values

Its simple and easy to sort just numerical values, we use sort -n for that – but values sometimes comes in human readable form like 4G, 350M and 120K. To sort these properly you will have to use sort -h flag as shown in the example below.

% du -sh /usr/*
102M    /usr/bin
228G    /usr/home
9.0M    /usr/include
 53M    /usr/lib
 43M    /usr/lib32
116K    /usr/libdata
1.9M    /usr/libexec
365M    /usr/local
512B    /usr/obj
9.5M    /usr/sbin
 39M    /usr/share
251K    /usr/tests

% du -sh /usr/* | sort -h
512B    /usr/obj
116K    /usr/libdata
251K    /usr/tests
1.9M    /usr/libexec
9.0M    /usr/include
9.5M    /usr/sbin
 39M    /usr/share
 43M    /usr/lib32
 53M    /usr/lib
102M    /usr/bin
365M    /usr/local
228G    /usr/home

If the values are in the first column then its simple but what to do when the values are not in the first column? You will use -k parameter of sort(1) which takes which column to sort as argument. Needed example below sorted bu human readable values and on the second USED column.

% zfs list | sort -h -k 2
NAME                         USED  AVAIL  REFER  MOUNTPOINT
local/usr/obj                 88K   130G    88K  /usr/obj
local/var/cache/pkg          128K   130G   128K  /var/cache/pkg
local/var/cache              216K   130G    88K  none
local/var                    304K   130G    88K  none
sys/ROOT/11.1-RELEASE        482M  2.39G  6.04G  /
local/usr/ports              729M   130G   729M  /usr/ports
local/jail/nextcloud         927M   130G   897M  /jail/nextcloud
local/jail                  1.00G   130G   100M  /jail
local/usr/src               1.28G   130G  1.28G  /usr/src
local/usr                   1.99G   130G    88K  none
sys/ROOT/11.2-RELEASE       8.69G  2.39G  7.10G  /
sys/ROOT                    9.16G  2.39G    88K  none
sys                         9.17G  2.39G    88K  none
local/home                   281G   130G   281G  /home
local                        288G   130G    88K  none

Write a File from vi(1) with Different Rights

How many times you have opened a system configuration file like /etc/sysctl.conf or /etc/fstab in your favorite vi(1) editor, made some changes and then when you wanted to save it – no luck – you are trying to write to file owned by root with regular user … the Read-only file, not written; use ! to override. message will be displayed. Of course you can save that file somewhere else like your home directory and them move it with doas(1)/sudo(8)/su(8) help to original location and fix its rights … or you may do that in one step instead.

After opening a file with vi(1) and some changes to write a file with doas(1)/sudo(8) rights you just need to type this.

:w !doas tee %

Then exit the vi(1) editor with force.

:q!

Here is how it looks in the editor.

:w !doas tee %

+=+=+=+=+=+=+=+
File contents are displayed here.

Press any key to continue [: to enter more ex commands]: [ENTER]

Here is the ‘legend’ for that spell.

:      vi(1) prompt
w      write a file
!doas  invoke doas(1) command
tee    command that will be started using doas(1) command
%      tells vi(1) to use current filename

In this process the current vi(1) contents will be redirected using tee(1) with doas(1) rights to the current (open that you opened) filename.

Of course it also works in vim(1) or neovim(1) and if sudo(8) is your poison then just use sudo instead doas(1) there.

Search Contents of PDF Files

We all love plain text files then they can be searched using grep(1) for data that is interesting for us … but grep(1) does not work with PDF files … or should I say its pointless/useless to use grep(1) to search PDF files. Fortunately pdfgrep(1) command exists and works beautifully with PDF files – including colored output.

Recently FreeBSD Journal has been made free and you will like to search for bhyve articles in FreeBSD Journal issues then this is the command for you.

% cd books/unix-bsd-journal
% exa
FreeBSD Journal - 2014-01-02.pdf FreeBSD Journal - 2016-09-10.pdf
FreeBSD Journal - 2014-03-04.pdf FreeBSD Journal - 2016-11-12.pdf
FreeBSD Journal - 2014-05-06.pdf FreeBSD Journal - 2017-01-02.pdf
FreeBSD Journal - 2014-07-08.pdf FreeBSD Journal - 2017-03-04.pdf
FreeBSD Journal - 2014-09-10.pdf FreeBSD Journal - 2017-05-06.pdf
FreeBSD Journal - 2014-11-12.pdf FreeBSD Journal - 2017-07-08.pdf
FreeBSD Journal - 2015-01-02.pdf FreeBSD Journal - 2017-09-10.pdf
FreeBSD Journal - 2015-03-04.pdf FreeBSD Journal - 2017-11-12.pdf
FreeBSD Journal - 2015-05-06.pdf FreeBSD Journal - 2018-01-02.pdf
FreeBSD Journal - 2015-07-08.pdf FreeBSD Journal - 2018-03-04.pdf
FreeBSD Journal - 2015-09-10.pdf FreeBSD Journal - 2018-05-06.pdf
FreeBSD Journal - 2015-11-12.pdf FreeBSD Journal - 2018-07-08.pdf
FreeBSD Journal - 2016-01-02.pdf FreeBSD Journal - 2018-09-10.pdf
FreeBSD Journal - 2016-03-04.pdf FreeBSD Journal - 2018-11-12.pdf
FreeBSD Journal - 2016-05-06.pdf FreeBSD Journal - 2019-01-02.pdf
FreeBSD Journal - 2016-07-08.pdf

% pdfgrep -i -n bhyve *.pdf
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: machine hypervisors, such as BHy
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: BHyVe
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: BHyVe IS THE BSD Hypervisor, de
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: Grehan and Neel Natu. The desig
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: BHyVe requires Intel CPUs w
FreeBSD Journal - 2014-01-02 - Old Release.pdf:6: BHyVe appeared in FreeBSD 1
FreeBSD Journal - 2014-01-02.pdf:42: machine hypervisors, such as BHyVe, Virtual
FreeBSD Journal - 2014-01-02.pdf:42: BHyVe e d
FreeBSD Journal - 2014-01-02.pdf:42: BHyVe IS THE BSD Hypervisor, developed by P
FreeBSD Journal - 2014-01-02.pdf:42: Grehan and Neel Natu. The design goal of BH
FreeBSD Journal - 2014-01-02.pdf:42: BHyVe requires Intel CPUs with VT-x and
FreeBSD Journal - 2014-01-02.pdf:42: BHyVe appeared in FreeBSD 10-CURRENT in
(...)

Here is how it looks in the xterm(1) terminal.

xterm-pdfgrep.png

Hope that today’s pack of spells will end up useful for you.

EOF
Advertisements

Valuable News – 2019/01/25

The Valuable News weekly series is dedicated to provide summary about news, articles and other interesting stuff mostly but not always related to the UNIX or BSD systems. Whenever I stumble upon something worth mentioning on the Internet I just put it here so someone else can

Today the amount information that we get using various information streams is at massive overload. Thus one needs to focus only on what is important without the need to grep(1) the Internet everyday. Hence the idea of providing such information ‘bulk’ as I already do that grep(1).

UNIX

FreeBSD fixed pfsync change that break CARP.
https://svnweb.freebsd.org/base?view=revision&revision=343130

Restoration of Early UNIX Artifacts.
https://www.usenix.org/legacy/events/usenix09/tech/full_papers/toomey/toomey.pdf

Amiga 500 Papercraft Pattern.
http://rockybergen.com/whatsnew/2019/1/15/amiga-500-papercraft-design
https://www.docdroid.net/file/download/PE7D4vg/amiga-500-ver1.pdf

Ansible BSD Working Group.
https://github.com/ansible/community/wiki/BSD

Ansible Solaris Working Group.
https://github.com/ansible/community/wiki/Solaris

In Other BSDs for 2019/01/19.
https://www.dragonflydigest.com/2019/01/19/22394.html

Debian systemd maintainer will not maintain systemd anymore.
“What’s going on is just too stupid/crazy.”
https://lists.freedesktop.org/archives/systemd-devel/2019-January/041971.html
https://www.reddit.com/r/linux/comments/agna5n/debian_systemd_maintainer_steps_down_over/

AMIGA gets LZ4 for 68k CPUs.
https://github.com/arnaud-carre/lz4-68k

[POLISH] ZFS – Rewolucja w Systemach Plikow (Mariusz Zaborski).
https://oshogbo.vexillium.org/pdf/programista_zfs_2015.pdf

LiteCLI is user friendly command line client for SQLite database.
https://www.pgcli.com/launching-litecli.html

OpenBSD can now join any open WiFi network.
https://undeadly.org/cgi?action=article;sid=20190120142708

OpenBSD deletes vmm(4) on i386.
https://undeadly.org/cgi?action=article;sid=20190120142529

NomadBSD 1.2-RC1 Released.
nomadbsd.org/index.html#rel1.2-rc1

Open source Spotify UNIX client available on FreeBSD as audio/spotifyd port.
https://svnweb.freebsd.org/ports?view=revision&revision=490765

OpenBSD added support for 2TB of memory on amd64.
https://undeadly.org/cgi?action=article;sid=20190121081245

HardenedBSD 1200058.2 Available.
https://hardenedbsd.org/article/op/2019-01-20/stable-release-hardenedbsd-stable-12-stable-v12000582

SoloBSD 19.01-STABLE based on HardenedBSD 1200058.2 Available.
https://www.solobsd.org/index.php/2019/01/23/solobsd-19-01-stable/

OmniOS Community Edition r151028l/r151026al/r151022cj Available.
https://omniosce.org/article/028l-026al-022cj

Wayland Support on BSDs Continuing to Improve.
https://www.phoronix.com/scan.php?page=news_item&px=Wayland-BSD-Improving-2019

Lumina from Project Trident will replace Fluxbox with their own WM after its finished.
https://twitter.com/q5sys/status/1087422097499062274

For the Love of Pipes.
https://blog.jessfraz.com/post/for-the-love-of-pipes/

FreeBSD adds trim(8) command for devices with wear leveling algorithms.
https://svnweb.freebsd.org/base?view=revision&revision=343118

ClarityOS is Safe/Secure/Modern/Reliable HardenedBSD fork.
Goal is to make BSD as open and customizable as possible, while keeping it easy, simple and accessible to as many people as possible!
https://clarityos.net/

MidnightBSD Developer Journal.
https://www.justjournal.com/users/mbsd/entry/33772

Out-of-the-Box 10GE Network Benchmarks on Linux Distributions and FreeBSD 12.
https://www.phoronix.com/scan.php?page=article&item=10gbe-linux-freebsd12&num=3

FreeBSD in top(1) will not now show swap line if there are no swap devices.
https://reviews.freebsd.org/D18928

Wine 4.0 Released.
https://www.winehq.org/news/2019012201

AMD Open Source Driver for Vulkan.
https://github.com/GPUOpen-Drivers/AMDVLK

Kerberized NFS4 in Mixed Environment.
FreeBSD 12.0-RELEASE as KDC/Kerberos/NFS4 Server with Windows/Ubuntu as Clients.
https://amoradi.org/public/kerberized_nfsv4.txt

XigmaNAS 11.2.0.4.6400 Released.
https://sourceforge.net/projects/xigmanas/files/XigmaNAS-11.2.0.4/11.2.0.4.6400/

FreeBSD utility nsysctl to show MIB tree in XML.
https://twitter.com/alfsiciliano/status/1087561685693427712

HOWTO – VNET Jails on FreeBSD 12 with ZFS.
https://www.reddit.com/r/freebsd/comments/ahdbbq/howto_jails_freebsd_12_vnet_zfs/

Building FreeBSD based home router.
https://kamila.is/learning/building-my-home-router/

Project Trident 18.12 Overview.
https://www.youtube.com/watch?v=4YizY1YblzU

What’s Wrong with tar?
https://www.cyphar.com/blog/post/20190121-ociv2-images-i-tar

BSD Now 282 – Open the Rsync.
https://bsdnow.fireside.fm/282

ClonOS 19.01-RELEASE Available – First Public Release.
https://clonos.tekroutine.com/download.html

Hardware

Rock Pi 4 Review – Is this Raspberry Pi challenger you’ve been looking for?
https://www.techrepublic.com/article/rock-pi-4-review-is-this-the-raspberry-pi-challenger-youve-been-looking-for/

Freedom and Privacy in the Datacenter.
https://media.ccc.de/v/froscon2018-2170-freedom_and_privacy_in_the_datacenter

Introducing Ultra EPYC AMD Powered Sun Ultra 24 Workstation.
https://www.servethehome.com/introducing-the-ultra-epyc-amd-powered-sun-ultra-24-workstation/

Thin-ITX AMD AM4 Motherboard.
https://www.anandtech.com/show/13885/the-true-shortest-am4-motherboard-thinitx-comes-to-amd

Backblaze Hard Drive Stats for 2018.
https://www.backblaze.com/blog/hard-drive-stats-for-2018/

Double Height DDR4 – 32GB Modules Reviewed.
https://www.anandtech.com/show/13694/double-height-ddr4-gskill-zadak-2x32gb-ddr4-3200

Life

Men’s and Women’s Brains.
https://www.youtube.com/watch?v=AQ9L9YBJkk8

Philip Zimbardoโ€™s Response to Recent Criticisms of the Stanford Prison Experiment.
https://www.prisonexp.org/response/

50 Years Ago Sugar Industry Quietly Paid Scientists to Point Blame at Fat.
https://www.npr.org/sections/thetwo-way/2016/09/13/493739074/50-years-ago-sugar-industry-quietly-paid-scientists-to-point-blame-at-fat

Students Learn From People They Love.
https://www.nytimes.com/2019/01/17/opinion/learning-emotion-education.html

The Process of Mastering a Skill.
https://azeria-labs.com/the-process-of-mastering-a-skill/

Real Hardware for the FreeBSD BeaST Storage System.
https://mezzantrop.wordpress.com/2019/01/18/the-real-hardware-for-the-beast-storage-system/

Remote Code Execution in Linux apt/apt-get Commands.
https://justi.cz/security/2019/01/22/apt-rce.html

The Alarming Decline of Quality Youth Playtime.
https://houseoflawandorder.com/the-alarming-decline-of-quality-youth-playtime/

Other

Quake 1.5 Refreshed FPS Classic with New Maps/Monsters/Mayhem.
https://www.rockpapershotgun.com/2019/01/18/quake-1-5-is-a-massive-mod-overhaul-for-the-fps-classic/amp/

EOF

Valuable News – 2018/12/14

The Valuable News weekly series is dedicated to provide summary about news, articles and other interesting stuff mostly but not always related to the UNIX or BSD systems. Whenever I stumble upon something worth mentioning on the Internet I just put it here so someone else can

Today the amount information that we get using various information streams is at massive overload. Thus one needs to focus only on what is important without the need to grep(1) the Internet everyday. Hence the idea of providing such information ‘bulk’ as I already do that grep(1).

UNIX

For The Love Of UFS.
https://youtu.be/oqbc7ICylcw

Introspection of My Thoughts on GhostBSD 18.10.
https://youtu.be/ESAlQjEvEHo

Visual Defragmenter for the Commodore 64.
https://www.pagetable.com/?p=978

From Bedrooms to Billions.
http://www.frombedroomstobillions.com/about-the-film

From Bedrooms to Billions: Amiga Years.
https://vimeo.com/ondemand/amiga

10 of the Best Video Game Documentaries.
https://www.vintagewave.net/blog/2018/11/30/10-of-the-best-video-game-documentaries

I Told You So. Again!
OpenSSL is Written by Monkeys.
https://www.peereboom.us/assl/assl/html/openssl.html

In Other BSDs for 2018/12/08.
https://www.dragonflydigest.com/2018/12/08/22175.html

Portability of tar features.
https://dev.gentoo.org/~mgorny/articles/portability-of-tar-features.html

How Douglas Engelbart Invented the Future.
https://www.smithsonianmag.com/innovation/douglas-engelbart-invented-future-180967498/

More Cavium Thunder X2 Commits Landed in FreeBSD.
https://svnweb.freebsd.org/base?view=revision&revision=341742
https://svnweb.freebsd.org/base?view=revision&revision=341743
https://svnweb.freebsd.org/base?view=revision&revision=341744

The tuxmachines.org Reviews GhostBSD 18.10.
http://www.tuxmachines.org/node/118061

Awesome UNIXยฎ.
Exploration of the world of UNIXยฎ including UNIX history and its relevance of today.
https://github.com/sirredbeard/Awesome-UNIX

FreeBSD 12 is Running Great On Dell PowerEdge R7425 EPYC Server.
https://www.phoronix.com/scan.php?page=article&item=freebsd12-dual-epyc

OpenSSH – Configuration to Keep Connection Alive.
https://dev.to/nabbisen/openssh-configuration-to-keep-connection-alive-to-suppress-timeout-3pa6

OPNsense Security Device Build.
https://cormier.co/post/opnsense-security-device-build/

OpenBSD on Laptop.
https://www.c0ffee.net/blog/openbsd-on-a-laptop/

Borg Backup 1.1.8 Released.
https://github.com/borgbackup/borg/releases/tag/1.1.8

FreeBSD Graphics Blog – Getting Started With drm-kmod.
https://freebsddesktop.github.io/2018/12/08/drm-kmod-primer.html

All HaikuOS kernel memory is now W^X.
https://git.haiku-os.org/haiku/commit/?id=cb0977326dd79327ff3e342816e0dd118019b058

FreeBSD adds ACPI based NUMA support for arm64.
https://svnweb.freebsd.org/base?view=revision&revision=341744

Installing MariaDB Server on OpenBSD.
https://dev.to/nabbisen/installing-mariadb-server-on-openbsd-5lm

OmniOS Community Edition r151{028f/026af/022cd}.
https://omniosce.org/article/release-028f-026af-022cd

FreeNAS 11.2 – Whats New?
https://youtu.be/uAbEFqnRJz0

Unprivileged Linux Users With UID Greater Then INT_MAX (2147483647) Can Execute Any Command.
https://thehackernews.com/2018/12/linux-user-privilege-policykit.html

OpenBSD on Microsoft Surface Go.
https://jcs.org/2018/08/31/surface_go

Sunny Valley Networks sponsored netmap(4) support for vtnet(4) to make it functional on FreeBSD.
https://svnweb.freebsd.org/base/stable/11/sys/dev/netmap/if_vtnet_netmap.h?revision=341478&view=markup

BSD Now 275 – OpenBSD in Stereo.
https://www.jupiterbroadcasting.com/128321/openbsd-in-stereo-bsd-now-275/

Oracle VM VirtualBox 6.0 RC1 Available.
https://blogs.oracle.com/virtualization/oracle-vm-virtualbox-60-release-candidate-1-now-available

KDE4 and QT4 Deprecated in FreeBSD.
KDE4 will be removed at the end of this year (before 2019/01).
QT4 will be removed in the middle of 2019/03.
https://euroquis.nl/bobulate/?p=2007

Clang updated to 7.0 in FreeBSD 13-CURRENT.
https://svnweb.freebsd.org/base?view=revision&revision=341825

PowerVM iSCSI Support.
https://www.ibm.com/developerworks/community/wikis/home?lang=en_us#!/wiki/Power%20Systems/page/iSCSI%20Support%20on%20PowerVM

Support for MacBookAir 7.1/7.2/8.1 added in FreeBSD.
https://svnweb.freebsd.org/base?view=revision&revision=341820
https://svnweb.freebsd.org/base?view=revision&revision=341988

OPNsense 18.7.9 Available.
https://forum.opnsense.org/index.php?topic=10650.0

Why should I have written ZeroMQ in C not C++ (Part I).
http://250bpm.com/blog:4

BSD Now 276 – Ho Ho Ho – 12.0.
https://www.jupiterbroadcasting.com/128421/ho-ho-ho-12-0-bsd-now-276/

Hardware

ARMed Attack – Intel/AMD Do Not See Torpedo Headed Their Way.
https://seekingalpha.com/article/4227086-armed-attack-intel-amd-see-torpedo-headed-way

Gigabyte MZ31-AR0 Review Single Socket AMD EPYC Motherboard.
https://www.servethehome.com/gigabyte-mz31-ar0-review-a-single-socket-amd-epyc-motherboard/

Super Micro says review found no malicious chips in motherboards.
https://www.reuters.com/article/us-supermicro-chips/super-micro-says-review-found-no-malicious-chips-in-motherboards-idUSKBN1OA12R

Why I’m usually unnerved when modern SSDs die on us.
https://utcc.utoronto.ca/~cks/space/blog/tech/SSDDeathDisturbing

First Pictures of 10nm Intel Ice Lake Xeon Server Chips.
https://www.servethehome.com/first-pictures-of-intel-ice-lake-xeon-server-chips/

Intel Architecture Day 2018 – Future of Core/Intel GPUs/10nm/Hybrid x86.
https://www.anandtech.com/show/13699/intel-architecture-day-2018-core-future-hybrid-x86

Life

Reason Many Ultrarich People Are Not Satisfied with Their Wealth.
https://www.theatlantic.com/family/archive/2018/12/rich-people-happy-money/577231/

Your Apps Know Where You Were Last Night and Theyโ€™re Not Keeping It Secret.
https://www.nytimes.com/interactive/2018/12/10/business/location-data-privacy-apps.html

Golden Age of Rich People Not Paying Their Taxes.
https://www.theatlantic.com/politics/archive/2018/12/rich-people-are-getting-away-not-paying-their-taxes/577798/

Other

Qualcomm says native Firefox browser is coming to Windows on ARM.
https://www.theverge.com/2018/12/6/18129456/qualcomm-snapdragon-pc-firefox-web-browser-64-bit-native-mozilla

Browser Diversity Starts with Us.
https://www.zeldman.com/2018/12/07/browser-diversity-starts-with-us/

Firefox Dilemma.
https://blog.tawhidhannan.co.uk/tech-zoomed-out/industry/firefox-dilemma/

Firefox 64 Released.
https://hacks.mozilla.org/2018/12/firefox-64-released/

Midori Browser 7.x Available.
https://www.midori-browser.org/2018/11/30/lorem-ipsum/

Google transferred ownership of Duck.com domain to DuckDuckGo.
https://www.namepros.com/blog/confirmed-duck-com-transfers-to-duckduckgo.1113728/

50 CVEs in 50 Days – Fuzzing Adobe Reader.
https://research.checkpoint.com/50-adobe-cves-in-50-days/

Windows 10 is still telling Microsoft what you’re doing even if you don’t want it to.
Microsoft baffles Windows 10 users by apparently collecting data about recently opened websites and apps when users have opted against sharing that information.
https://www.zdnet.com/article/is-windows-10-still-telling-microsoft-what-youre-doing-even-if-you-dont-want-it-to/

EOF

Valuable News – 2018/11/24

The Valuable News weekly series is dedicated to provide summary about news, articles and other interesting stuff mostly but not always related to the UNIX or BSD systems. Whenever I stumble upon something worth mentioning on the Internet I just put it here so someone else can

Today the amount information that we get using various information streams is at massive overload. Thus one needs to focus only on what is important without the need to grep(1) the Internet everyday. Hence the idea of providing such information ‘bulk’ as I already do that grep(1).

UNIX

In Other BSDs for 2018/11/17.
https://www.dragonflydigest.com/2018/11/17/22071.html

Nixers Newsletter – 2018-11-16 – 101.
https://newsletter.nixers.net/entries.php#101

FreeBSD 12.0-RC1 Available.
https://lists.freebsd.org/pipermail/freebsd-stable/2018-November/090020.html

SoloBSD 11.2-STABLE-1117 based on HardenedBSD 1100056.8.
https://www.solobsd.org/index.php/2018/11/17/solobsd-11-2-stable-1117/

Celebrating 50 years of Unix.
https://unix50.org/

Distrowatch.com NetBSD 8.0 Review.
https://distrowatch.com/weekly.php?issue=20181119#netbsd

QEMU with Bridged tap0 Interface on FreeBSD Host.
https://thebsd.club/index.php?p=/discussion/8/qemu-with-a-bridged-tap0-interface-on-a-freebsd-host

Webmin module called ZFS Manager supports managing Boot Environments with beadm tool.
https://github.com/jonmatifa/zfsmanager/issues/28

Running Windows software on ARM with Wine.
http://www.osnews.com/story/30880/Running_Windows_software_on_ARM_with_Wine

Games on FreeBSD.
https://oshogbo.vexillium.org/blog/58/

Trying DragonFly BSD & FreeBSD On Intel Core i9 9900K.
https://www.phoronix.com/scan.php?page=article&item=intel-9900k-bsd

Playing Games on Pinebook on NetBSD-current arm64.
https://twitter.com/astr0baby/status/1065353771952336897

FreeBSD for Thanksgiving.
https://bwidawsk.net/blog/index.php/2018/11/freebsd-for-thanksgiving/

Goals for FreeBSD 13.
https://hackmd.io/Yv46aOjTS0eYk0m4YLXOTw#

Abandon Linux. Move to FreeBSD or Illumos.
https://www.adminbyaccident.com/politics/abandon-linux-move-freebsd-illumos/

OPNsense 18.7.8 Released.
https://forum.opnsense.org/index.php?topic=10366.0

NetworkManager mandatory on RHEL8 systems.
https://twitter.com/iMilnb/status/1065500360159170560

How to install and configure FreeBSD 11.2.
https://jacekkowalczyk.wordpress.com/2018/11/23/how-to-install-and-configure-freebsd-11-2/

BSD Now 273 – Thoughtful Episode.
https://www.jupiterbroadcasting.com/128146/a-thoughtful-episode-bsd-now-273/

Debugging rcctl in OpenBSD.
https://dev.to/nabbisen/debugging-rcctl-in-openbsd-3e70

In Other BSDs for 2018/11/24.
https://www.dragonflydigest.com/2018/11/24/22103.html

The nnn – The fastest terminal file manager ever written.
https://github.com/jarun/nnn

Hardware

An Excellent Machine.
POWER9 Based Talos II System from Raptor Computing Thoughts.
https://www.fitzsim.org/blog/?p=350

AMD Discloses Initial Zen 2 Details. 64 cores.
https://fuse.wikichip.org/news/1815/amd-discloses-initial-zen-2-details/

Pinebook – My First Few Surprising Hours With $99 Linux Laptop.
https://www.forbes.com/sites/jasonevangelho/2018/11/21/pinebook-my-first-few-surprising-hours-with-a-99-linux-laptop/amp/

Pinebook TN 720p versus Pinebook IPS 1080p.
https://twitter.com/armbian/status/1065713551401254912

ARM Delivers on Cortex A76 Promises: What it Means for 2019 Devices.
https://www.anandtech.com/show/13614/arm-delivers-on-cortex-a76-promises

Life

Edward Snowden Explains Blockchain to His Lawyer.
https://www.aclu.org/blog/privacy-technology/internet-privacy/edward-snowden-explains-blockchain-his-lawyer-and-rest-us

Going to university does not broaden the mind.
But going straight from school to work narrows it.
https://www.economist.com/science-and-technology/2018/11/24/going-to-university-does-not-broaden-the-mind

What’s Going On In Your Child’s Brain When You Read Them A Story?
https://www.kqed.org/mindshift/51281/whats-going-on-in-your-childs-brain-when-you-read-them-a-story

Other

Resistance is Real.
http://davemart.in/resistance/

 

EOF

Valuable News – 2018/10/20

The Valuable News weekly series is dedicated to provide summary about news, articles and other interesting stuff mostly but not always related to the UNIX or BSD systems. Whenever I stumble upon something worth mentioning on the Internet I just put it here so someone else can

Today the amount information that we get using various information streams is at massive overload. Thus one needs to focus only on what is important without the need to grep(1) the Internet everyday. Hence the idea of providing such information ‘bulk’ as I already do that grep(1).

UNIX

OpenBSD vmm(8) now runs CentOS 7 Linux.
https://twitter.com/l8n8dude/status/1050696721129504768

Freedesktop.org – Its Past and Its Future.
https://lwn.net/Articles/767258/

Linux elementary OS 5 Juno Available.
Still no desktop icons.
https://medium.com/elementaryos/elementary-os-5-juno-is-here-471dfdedc7b3

Unix in East Germany (GDR) from 1982.
https://groups.google.com/forum/m/#!topic/comp.unix.wizards/QX_dxElrVNs

FreeBSD 12.0-ALPHA10 Available.
https://lists.freebsd.org/pipermail/freebsd-snapshots/2018-October/000464.html

Oracle VM VirtualBox 5.2.20 Available.
https://blogs.oracle.com/virtualization/oracle-vm-virtualbox-5220-now-available

Arcan versus Xorg – Approaching Feature Parity.
Arcan versus Xorg – Approaching Feature Parity

Kubernetes with IBM AIX container technology.
https://twitter.com/cgibbo/status/1052650460585185280

Fonts on Unix.
Really great in depth guide to fonts on UNIX systems.
https://venam.nixers.net/blog/unix/2017/06/04/fonts-on-unix.html

OpenBSD 6.4 Released.
https://www.openbsd.org/64.html

PostgreSQL 11 Released.
https://www.postgresql.org/about/news/1894/

2ndQuadrant contributes major features to PostgreSQL 11.
https://www.2ndquadrant.com/en/about/news/2ndquadrant-contributes-major-features-postgresql-11/

OpenBSD Mail Smarthost Runbook.
https://paulgorman.org/technical/openbsd-smarthost-runbook.txt.html

Upgrading OpenBSD with Ansible.
https://chown.me/blog/upgrading-openbsd-with-ansible.html

FreeNAS 11.2-RC1 Available.
https://www.ixsystems.com/blog/library/freenas-11-2-rc1/

FreeBSD HEAD is now known as 13-CURRENT.
https://svnweb.freebsd.org/base?view=revision&revision=339436

FreeBSD has initial driver for ACPI NFIT enumerated NVDIMMs.
https://svnweb.freebsd.org/base?view=revision&revision=339391

CAM drivers in FreeBSD over time.
https://github.com/bsdimp/device-data/blob/master/cam.md

OpenBSD on the AMD Ryzen powered ThinkPad A485.
https://deftly.net/posts/2018-10-15-openbsd-on-lenovo-a485.html

Hardware

RISC-V: More Than Core.
https://semiengineering.com/risc-v-more-than-a-core/

Backblaze 2018 Q3 Hard Drive Stats: Less is More.
https://www.backblaze.com/blog/2018-hard-drive-failire-rates/

ODROID-H2 mini PC board with Celeron J4105.
https://liliputing.com/2018/10/odroid-h2-mini-pc-board-with-celeron-j4105-gemini-lake-cpu-coming-next-month.html

Zotac Zbox PI225 pico Mini PC Review.
https://www.tomsguide.com/us/zotac-zbox-pico-mini-pc,review-5857.html

Business card-sized Japanese phone bucks the giant-phone trend.
https://arstechnica.com/gadgets/2018/10/this-business-card-sized-japanese-phone-bucks-the-giant-phone-trend/

Life

Itโ€™s better to be born rich than gifted.
https://www.washingtonpost.com/business/2018/10/09/its-better-be-born-rich-than-talented/?noredirect=on&utm_term=.1283300b875f

Good Sleep, Good Learning, Good Life.
https://www.supermemo.com/en/articles/sleep.

Microplastics found in 90 percent of table salt.
https://www.nationalgeographic.com/environment/2018/10/microplastics-found-90-percent-table-salt-sea-salt/

Other

Ideas for scaling PostgreSQL to multi-terabyte and beyond.
https://www.cybertec-postgresql.com/en/ideas-for-scaling-postgresql-to-multi-terabyte-and-beyond/

Make Firefox Great Faster Again.
https://twitter.com/romanzolotarev/status/1053568896945569792

EOF

Valuable News – 2018/10/07

The Valuable News weekly series is dedicated to provide summary about news, articles and other interesting stuff mostly but not always related to the UNIX or BSD systems. Whenever I stumble upon something worth mentioning on the Internet I just put it here so someone else can

Today the amount information that we get using various information streams is at massive overload. Thus one needs to focus only on what is important without the need to grep(1) the Internet everyday. Hence the idea of providing such information ‘bulk’ as I already do that grep(1).

UNIX

Using Dummynet for Traffic Shaping on FreeBSD.
https://www.hyperois.com/members/knowledgebase.php?action=displayarticle&id=1

HardenedBSD 1100056.6 Released.
https://hardenedbsd.org/article/op/2018-09-30/stable-release-hardenedbsd-stable-11-stable-v11000566

Cache Invalidation Bug in Linux Memory Management.
https://googleprojectzero.blogspot.com/2018/09/a-cache-invalidation-bug-in-linux.html

IBM is responsible for making \ the path separator instead of / in MS-DOS.
https://twitter.com/fahickman/status/1045809677827596288
https://github.com/Microsoft/MS-DOS/blob/master/v2.0/source/README.txt

State of Memory Safety in Linux.
https://blog.araj.me/state-of-memory-safety-in-linux/

Haiku R1/Beta1 Released.
http://www.osnews.com/story/30758/Haiku_R1_beta_1_released
https://www.haiku-os.org/get-haiku/release-notes/

FreshRSS – free self-hostable aggregator.
https://freshrss.org/

Miniflux is a minimalist and opinionated feed reader.
https://miniflux.app/

Using very old ZFS filesystem can give you kernel panic on Linux.
https://utcc.utoronto.ca/~cks/space/blog/linux/ZFSOldFilesystemPanic

OpenBSD vmd(8) now works out of the box on AMD Ryzen.
https://twitter.com/LeoUnglaub/status/1046058268555186176

The origin of the name POSIX.
https://stallman.org/articles/posix.html

PostgreSQL Per-Table Autovacuum Tuning.
https://www.keithf4.com/per-table-autovacuum-tuning/

Sequence Caching: Oracle vs. PostgreSQL.
https://seiler.us/2018-10-02-sequence-caching-oracle-vs-postgresql/

Polish BSD User Group.
https://oshogbo.vexillium.org/blog/55/

OpenSSH 2.3-7.4 Mass Username Enumeration (CVE-2018-15473).
https://github.com/trimstray/massh-enum

The POWER9 Desktop is Now Official!
https://twitter.com/PCzanik/status/1047782986660364290

If you were the Linus Torvalds of FreeBSD what would be the first thing you would change?
https://twitter.com/freebsdbytes/status/1047563491828277253

BSD Now 266 – File Type History.
https://www.jupiterbroadcasting.com/127441/file-type-history-bsd-now-266/

OpenBSD on the Desktop: some thoughts.
https://blog.gsora.xyz/openbsd-on-the-desktop-some-thoughts/

Installing Gophernicus in OpenBSD.
http://gopher.solobsd.org/gophernicus.html?utm_source=discoverbsd

FreeBSD finally updates GNOME port to 3.28 version.
https://twitter.com/wezm/status/1047990697838563329
https://svnweb.freebsd.org/ports?view=revision&revision=480951
https://help.gnome.org/misc/release-notes/3.28/

FreeBSD – FCP-0101 – Deprecating Most 10/100 Ethernet Drivers.
https://lists.freebsd.org/pipermail/freebsd-stable/2018-October/089717.html

In Other BSDs for 2018/10/06.
https://www.dragonflydigest.com/2018/10/06/21880.html

DTrace is coming to Windows. Already available on FreeBSD/macOs/Illumos. The only holdout is Linux.
https://twitter.com/TheGlasspelican/status/1048405923318943744
https://youtu.be/tG8R5SQGPck?t=732

Announcing pkgsrc-2018Q3 Release.
https://mail-index.netbsd.org/tech-pkg/2018/10/05/msg020326.html?utm_source=discoverbsd

Migrating OmniOS VM from KVM to bhyve.
https://omniosce.org/info/bhyve_migrate

FreeBSD diskinfo -wS (synchronous writes) bandwidth limits on Optane devices.
https://twitter.com/nickprincipe/status/1048251974532124673

First SmartOS snapshot with bhyve support as alternative hypervisor to QEMU/KVM.
https://bsd.network/@sehnsucht/100843128594097501
http://us-east.manta.joyent.com/Joyent_Dev/public/SmartOS/smartos.html#20180315T080815Z
https://github.com/joyent/smartos-live/commit/48cb3c49e1a9c4cf204a59bed8312b0096f6209e

FreeBSD amd64: make memset less slow with mov.
https://svnweb.freebsd.org/base?view=revision&revision=339205

Hardware

AMD 12-core (2970WX) and 24-core (2920X) Threadripper 2 CPUs on 29th October.
https://www.anandtech.com/show/13443/amd-announces-availability-of-12-and-24core-threadripper-2-cpus-coming-late-october

RISC-V Inches Toward The Center.
https://semiengineering.com/risc-v-inches-toward-the-center/

Lenovo ThinkPad X1 Extreme / 6-core / 64 GB RAM / GTX 1050 Ti / under 4 pounds.
https://arstechnica.com/gadgets/2018/08/lenovos-thinkpad-x1-extreme-hex-core-gtx-1050-ti-64gb-ram-under-4-pounds/

ARM Partners with Xilinx to Bring Cortex-M Processors to FPGAs.
https://blog.hackster.io/arm-partners-with-xilinx-to-bring-cortex-m-processors-to-fpga-be60b4c77b1a

iDRACula Vulnerability Impacts Millions of Legacy Dell EMC Servers.
https://www.servethehome.com/idracula-vulnerability-impacts-millions-of-legacy-dell-emc-servers/

Wi-Fi Alliance Introduces Wi-Fi 6 (802.11ax) Technology.
Wi-Fi 5 to identify devices that support 802.11ac technology.
Wi-Fi 4 to identify devices that support 802.11n technology
https://www.wi-fi.org/news-events/newsroom/wi-fi-alliance-introduces-wi-fi-6

MicroZed Chronicles: XDF & Versal.
https://blog.hackster.io/microzed-chronicles-xdf-versal-b5a04cd0f973

Intel Customized SoC for HP: Amber Lake-Y with On-Package LTE Modem.
https://www.anandtech.com/show/13434/intel-custom-amber-lake-y-with-lte-modem

High resolution photos of the motherboard that looks almost the same in Bloomberg.
https://twitter.com/1kevin335200/status/1047960097937346566

Life

Insufficient Sleep Associated with Risky Teen Behavior.
https://neurosciencenews.com/sleep-teen-behavior-9938/

Annoying habits of highly effective people.
https://www.economist.com/business/2018/09/29/the-annoying-habits-of-highly-effective-people

Your IQ Matters Less Than You Think.
http://nautil.us/issue/65/in-plain-sight/your-iq-matters-less-than-you-think

Other

World’s Oldest Torrent Still Alive After 15 Years.
https://torrentfreak.com/worlds-oldest-torrent-still-alive-after-15-years-180929/

After Seeing These 15 Maps You’ll Never Look At The World The Same.
http://www.physics-astronomy.org/2018/05/after-seeing-these-15-maps-youll-never.html

EOF

Wallpapers from Tech Pron

The Tech Pron at Twitter – @techno_pron – is a bot that posts aesthetic tech pics. Most of these computers pictures were made on a solid (or close to it) background color so I though it may be a cool idea to create wallpapers from them.

I have picked up 20 most interesting ones and made high resolution backgrounds of them. Here is their montage.

wallpapers-oldschool-machines.jpg

To download them all just follow this wallpapers-oldschool-machines.tar.gz file.

When needed use my random_wallpaper.sh handler from the https://github.com/vermaden/scripts repository to setup random wallpaper from directory.

EOF