PETS
A Configuration Management System for computers that are Pets, not Cattle.
This is for people who need to administer a handful of machines, all fairly different from each other and all Very Important. Those systems are not Cattle! They’re actually a bit more than Pets. They’re almost Family. For example: a laptop, workstation, and that personal tiny server in Sweden. They are all named after something dear.
pets works on Linux systems. The following distro families are supported:
-
Debian-like (APT)
-
RedHat-like (YUM)
-
Alpine (APK)
Summary
Pets is the first configuration management system driven by comments embedded in the config files themselves, rather than by a domain-specific language (DSL). For example, say you want to ensure that user "ema" has sudo rights. Create a file with the following contents under $HOME/pets/
, run pets
as root, done. The file can be called whatever you want. Note that pets will install the sudo
package for you if missing.
# pets: destfile=/etc/sudoers.d/ema, owner=root, group=root, mode=0440 # pets: package=sudo # pets: pre=/usr/sbin/visudo -cf ema ALL=(ALL:ALL) NOPASSWD:ALL
Usage
Build and install pets with:
$ go install github.com/ema/[email protected]
The following options are supported:
$ pets -h Usage of ./pets: -conf-dir string Pets configuration directory (default "/home/ema/pets") -debug Show debugging output -dry-run Only show changes without applying them
Let’s say you’ve decided to put your configuration files under /etc/pets
. The system can then be used with:
# pets -conf-dir /etc/pets
See sample_pet for a basic example of what your /etc/pets
can look like. Note that directory structure is arbitrary, you can have as many directories as you want, call them what you want, and so on.
Design overview
The idea behind Pets is that Configuration Management of individual hosts shouldn’t be harder than administering the system by hand. Other configuration management tools typically focus on usage scenarios involving complex relationships between multiple, fairly homogeneous systems: for example, setting up a bunch of application servers behind a load-balancer, or configuring a database and its replicas. For that you need a templating language, some way to store and share information about the various systems, and a way to either push the changes to all hosts or pull them from a central location. All that complexity can discourage from using a configuration management tool to begin with: why bother with Chef syntax and ERB templates if you just need to edit a few files?
Pets instead focuses on the individual, local machine. No need to ssh anywhere, no puppetmaster to configure, nada. It works by reading your regular, static configuration files (say muttrc) with added pets modelines, inspired by the concept of vim modelines. Pets can copy your configuration files to the right place, fix permissions, install packages, and run commands upon file update.
Following from this basic idea, here are the design decisions:
-
Runs locally on a single machine
-
One directory holds the full configuration of the system
-
No variables, no templates, just plain static config files
-
No dependencies between different components (eg: updating file A if and after file B was updated)
-
A single one-shot program reading the configuration directory and applying changes
-
Changes are applied only if basic syntax checks pass
-
Main interaction mechanism inspired by vim modelines
Here’s the initial design document in all its beauty. Ignore the "watcher" part, that was before I settled on a one-shot approach.
Configuration directives
-
destfile — where to install this file. One of either destfile or symlink must be specified.
-
symlink — create a symbolic link to this file, instead of copying it like destfile would.
-
owner — the file owner, passed to chown(1)
-
group — the group this file belongs to, passed to chgrp(1)
-
mode — octal mode for chmod(1)
-
package — which package to install before creating the file. This directive can be specificed more than once to install multiple packages.
-
pre — validation command. This must succeed for the file to be created / updated.
-
post — apply command. Usually something like reloading a service.
Configuration directives are passed as key/value arguments, either on multiple lines or separated by commas.
# pets: package=ssh, pre=/usr/sbin/sshd -t -f
The example above and the one below are equivalent
# pets: package=ssh # pets: pre=/usr/sbin/sshd -t -f
Examples
Firewall
Say you want to configure the local firewall to drop all incoming traffic except for ssh? Here’s an example that does the following:
-
Installs
ferm
if missing -
Validates the configuration with
/usr/sbin/ferm -n
-
If the configuration is valid, copies it under
/etc/ferm/ferm.conf
-
Reloads the firewall rules with
systemctl reload
# pets: destfile=/etc/ferm/ferm.conf, owner=root, group=root, mode=644 # pets: package=ferm # pets: pre=/usr/sbin/ferm -n # pets: post=/bin/systemctl reload ferm.service domain (ip ip6) { table filter { chain INPUT { policy DROP; # connection tracking mod state state INVALID DROP; mod state state (ESTABLISHED RELATED) ACCEPT; # allow local packets interface lo ACCEPT; # respond to ping proto icmp ACCEPT; # allow SSH connections proto tcp dport ssh ACCEPT; } chain OUTPUT { policy ACCEPT; } chain FORWARD { policy DROP; } } }
SSH Server
# pets: destfile=/etc/ssh/sshd_config, owner=root, group=root, mode=0644 # pets: package=ssh # pets: package=openssh-client-dbgsym # pets: pre=/usr/sbin/sshd -t -f # pets: post=/bin/systemctl reload ssh.service # # Warning! This file has been generated by pets(1). Any manual modification # will be lost. Port 22 Protocol 2 HostKey /etc/ssh/ssh_host_rsa_key HostKey /etc/ssh/ssh_host_dsa_key HostKey /etc/ssh/ssh_host_ecdsa_key HostKey /etc/ssh/ssh_host_ed25519_key # Change to yes to enable challenge-response passwords (beware issues with # some PAM modules and threads) ChallengeResponseAuthentication no # Change to no to disable tunnelled clear text passwords PasswordAuthentication no X11Forwarding yes # Allow client to pass locale environment variables AcceptEnv LANG LC_* Subsystem sftp /usr/lib/openssh/sftp-server UsePAM yes
Reception
Pets was featured on Hacker News and on Lobsters.
The author of Chef started an interesting Twitter thread about Pets too.
Fix failing test for alpine
Hi! This an attempt to fix fling tests for alpine. I made path to coreutls bin configurable that resolved some issues with chmod/chown , however one test still fails, please see - https://ci.sparrowhub.io/report/1781
And I don't now why, code of package.go should return false, but it seems it returns true:
https://github.com/melezhik/pets/blob/1bfa2969b1c536d29a3a8528ddd0aeec4d31ce9c/package.go#L135-L138
Awesome project
Hey!
Originally I wanted to send you an email, but I couldn't find a way of contacting you except twitter (which I don't have/use). Hence, the dirty message in ticket approach.
The thing is, that I'm currently in the design phase of a tool that has the exact same use-case.
My plan was to meet up with a good friend in a few days to verify the design. Imagine my astonishment when he sent me your project this morning :D. At this point, I want to say that I really like the name of the project.
What was most surprising is that you went with a few core design decisions I was keen on using, but really wasn't sure about:
From here on, the design starts to differs quite a bit though. I planned to have the configuration for various different systems in the same directory, including a way to have a "base" configuration that's shared for all systems. My plan was also to go with templating (at least for those "base" files), even though I'm not yet sure how to inject variables in a nice way.
From what I understand, your plan is to keep this project rather minimalistic (which I respect a lot) and stick to your design decisions.
If that's the case, I'll probably continue building my project as planned :). I just wanted to tell you aren't the only one that's annoyed by the current PC configuration situation :D.
Best regards,
Arne Beer
Support for symlinking files
Great project.
If files could be symlinked rather then moved itd be great for combining with a dot files git repo or for more easily managing config files without needing to run the command every time you change a file
Usage exmaple?
I red through the Readme and got some understanding on what it is supposed to do. But I have no clue about how to run it or how my folder structure would look like etc. Some usage example could help
A bit more examples
Is it possible to add more examples? For example, I would like to see if PETS can replace my Ansible stuff on my home server. I have runbooks for this: