|
Introducing the Shell
|
A shell is a program whose primary purpose is to read commands and run other programs.
The shell’s main advantages are its high action-to-keystroke ratio, its support for automating repetitive tasks, and its capacity to access networked machines.
The shell’s main disadvantages are its primarily textual nature and how cryptic its commands and operation can be.
|
|
Navigating Files and Directories
|
The file system is responsible for managing information on the disk.
Information is stored in files, which are stored in directories (folders).
Directories can also store other directories, which forms a directory tree.
cd path changes the current working directory.
ls path prints a listing of a specific file or directory; ls on its own lists the current working directory.
pwd prints the user’s current working directory.
/ on its own is the root directory of the whole file system.
A relative path specifies a location starting from the current location.
An absolute path specifies a location from the root of the file system.
Directory names in a path are separated with / on Unix, but \ on Windows.
.. means ‘the directory above the current one’; . on its own means ‘the current directory’.
|
|
Working With Files and Directories
|
cp old new copies a file.
mkdir path creates a new directory.
mv old new moves (renames) a file or directory.
rm path removes (deletes) a file.
* matches zero or more characters in a filename, so *.txt matches all files ending in .txt.
? matches any single character in a filename, so ?.txt matches a.txt but not any.txt.
Use of the Control key may be described in many ways, including Ctrl-X, Control-X, and ^X.
The shell does not have a trash bin: once something is deleted, it’s really gone.
Most files’ names are something.extension. The extension isn’t required, and doesn’t guarantee anything, but is normally used to indicate the type of data in the file.
Depending on the type of work you do, you may need a more powerful text editor than Nano.
ls -l will show file permissions next to the list of files
chmod can be used to change the permissions of files and directories
|
|
Pipes and Filters
|
cat displays the contents of its inputs.
head displays the first 10 lines of its input.
tail displays the last 10 lines of its input.
sort sorts its inputs.
wc counts lines, words, and characters in its inputs.
command > file redirects a command’s output to a file (overwriting any existing content).
command >> file appends a command’s output to a file.
first | second is a pipeline: the output of the first command is used as the input to the second.
The best way to use the shell is to use pipes to combine simple single-purpose programs (filters).
|
|
Loops
|
A for loop repeats commands once for every thing in a list.
Every for loop needs a variable to refer to the thing it is currently operating on.
Use $name to expand a variable (i.e., get its value). ${name} can also be used.
Do not use spaces, quotes, or wildcard characters such as ‘*’ or ‘?’ in filenames, as it complicates variable expansion.
Give files consistent names that are easy to match with wildcard patterns to make it easy to select them for looping.
Use the up-arrow key to scroll up through previous commands to edit and repeat them.
Use Ctrl+R to search through the previously entered commands.
Use history to display recent commands, and !number to repeat a command by number.
|
|
Shell Scripts
|
Save commands in files (usually called shell scripts) for re-use.
bash filename runs the commands saved in a file.
$@ refers to all of a shell script’s command-line arguments.
$1, $2, etc., refer to the first command-line argument, the second command-line argument, etc.
Place variables in quotes if the values might have spaces in them.
Letting users decide what files to process is more flexible and more consistent with built-in Unix commands.
|
|
Finding Things
|
find finds files with specific properties that match patterns.
grep selects lines in files that match patterns.
--help is an option supported by many bash commands, and programs that can be run from within Bash, to display more information on how to use these commands or programs.
man command displays the manual page for a given command.
$(command) inserts a command’s output in place.
|
|
Remote Access to Other Systems
|
ssh starts a secure shell session on a remote server.
ssh -Y starts a secure shell session with graphics.
‘ssh’ can also be used to directly send commands.
scp copies files and directories to and from remote servers
You can use ‘scp’ and ‘ssh’ from the Terminal in Mac OS X
Tools like cygwin and putty allow remote connections from Windows
|
|
The Shell Environment and Software Modules
|
env prints all of the currently defined environment variables.
export VAR=newvalue can be used to change the value of environment variables, or to set new ones.
module load MODULE changes the shell environment to allow use of new software packages.
module unload MODULE undoes the changes to the environment from a single module
module purge undoes the changes to the environment from all loaded modules
module avail and module avail MODULE can be used to find what software and versions are available.
module list will list all currently loaded modules.
module show MODULE will show all of the changes that the module MODULE will make to the environment when it is loaded.
|
The following is an overview of a standard Unix filesystem.
The exact hierarchy depends on the platform,
so you may not see exactly the same files/directories on your computer: