Magellan Linux

Contents of /trunk/mkinitrd-magellan/klibc/usr/dash/TOUR

Parent Directory Parent Directory | Revision Log Revision Log


Revision 532 - (show annotations) (download)
Sat Sep 1 22:45:15 2007 UTC (16 years, 8 months ago) by niro
File size: 17158 byte(s)
-import if magellan mkinitrd; it is a fork of redhats mkinitrd-5.0.8 with all magellan patches and features; deprecates magellan-src/mkinitrd

1 # @(#)TOUR 8.1 (Berkeley) 5/31/93
2
3 NOTE -- This is the original TOUR paper distributed with ash and
4 does not represent the current state of the shell. It is provided anyway
5 since it provides helpful information for how the shell is structured,
6 but be warned that things have changed -- the current shell is
7 still under development.
8
9 ================================================================
10
11 A Tour through Ash
12
13 Copyright 1989 by Kenneth Almquist.
14
15
16 DIRECTORIES: The subdirectory bltin contains commands which can
17 be compiled stand-alone. The rest of the source is in the main
18 ash directory.
19
20 SOURCE CODE GENERATORS: Files whose names begin with "mk" are
21 programs that generate source code. A complete list of these
22 programs is:
23
24 program intput files generates
25 ------- ------------ ---------
26 mkbuiltins builtins builtins.h builtins.c
27 mkinit *.c init.c
28 mknodes nodetypes nodes.h nodes.c
29 mksignames - signames.h signames.c
30 mksyntax - syntax.h syntax.c
31 mktokens - token.h
32 bltin/mkexpr unary_op binary_op operators.h operators.c
33
34 There are undoubtedly too many of these. Mkinit searches all the
35 C source files for entries looking like:
36
37 INIT {
38 x = 1; /* executed during initialization */
39 }
40
41 RESET {
42 x = 2; /* executed when the shell does a longjmp
43 back to the main command loop */
44 }
45
46 SHELLPROC {
47 x = 3; /* executed when the shell runs a shell procedure */
48 }
49
50 It pulls this code out into routines which are when particular
51 events occur. The intent is to improve modularity by isolating
52 the information about which modules need to be explicitly
53 initialized/reset within the modules themselves.
54
55 Mkinit recognizes several constructs for placing declarations in
56 the init.c file.
57 INCLUDE "file.h"
58 includes a file. The storage class MKINIT makes a declaration
59 available in the init.c file, for example:
60 MKINIT int funcnest; /* depth of function calls */
61 MKINIT alone on a line introduces a structure or union declara-
62 tion:
63 MKINIT
64 struct redirtab {
65 short renamed[10];
66 };
67 Preprocessor #define statements are copied to init.c without any
68 special action to request this.
69
70 INDENTATION: The ash source is indented in multiples of six
71 spaces. The only study that I have heard of on the subject con-
72 cluded that the optimal amount to indent is in the range of four
73 to six spaces. I use six spaces since it is not too big a jump
74 from the widely used eight spaces. If you really hate six space
75 indentation, use the adjind (source included) program to change
76 it to something else.
77
78 EXCEPTIONS: Code for dealing with exceptions appears in
79 exceptions.c. The C language doesn't include exception handling,
80 so I implement it using setjmp and longjmp. The global variable
81 exception contains the type of exception. EXERROR is raised by
82 calling error. EXINT is an interrupt. EXSHELLPROC is an excep-
83 tion which is raised when a shell procedure is invoked. The pur-
84 pose of EXSHELLPROC is to perform the cleanup actions associated
85 with other exceptions. After these cleanup actions, the shell
86 can interpret a shell procedure itself without exec'ing a new
87 copy of the shell.
88
89 INTERRUPTS: In an interactive shell, an interrupt will cause an
90 EXINT exception to return to the main command loop. (Exception:
91 EXINT is not raised if the user traps interrupts using the trap
92 command.) The INTOFF and INTON macros (defined in exception.h)
93 provide uninterruptable critical sections. Between the execution
94 of INTOFF and the execution of INTON, interrupt signals will be
95 held for later delivery. INTOFF and INTON can be nested.
96
97 MEMALLOC.C: Memalloc.c defines versions of malloc and realloc
98 which call error when there is no memory left. It also defines a
99 stack oriented memory allocation scheme. Allocating off a stack
100 is probably more efficient than allocation using malloc, but the
101 big advantage is that when an exception occurs all we have to do
102 to free up the memory in use at the time of the exception is to
103 restore the stack pointer. The stack is implemented using a
104 linked list of blocks.
105
106 STPUTC: If the stack were contiguous, it would be easy to store
107 strings on the stack without knowing in advance how long the
108 string was going to be:
109 p = stackptr;
110 *p++ = c; /* repeated as many times as needed */
111 stackptr = p;
112 The folloing three macros (defined in memalloc.h) perform these
113 operations, but grow the stack if you run off the end:
114 STARTSTACKSTR(p);
115 STPUTC(c, p); /* repeated as many times as needed */
116 grabstackstr(p);
117
118 We now start a top-down look at the code:
119
120 MAIN.C: The main routine performs some initialization, executes
121 the user's profile if necessary, and calls cmdloop. Cmdloop is
122 repeatedly parses and executes commands.
123
124 OPTIONS.C: This file contains the option processing code. It is
125 called from main to parse the shell arguments when the shell is
126 invoked, and it also contains the set builtin. The -i and -j op-
127 tions (the latter turns on job control) require changes in signal
128 handling. The routines setjobctl (in jobs.c) and setinteractive
129 (in trap.c) are called to handle changes to these options.
130
131 PARSING: The parser code is all in parser.c. A recursive des-
132 cent parser is used. Syntax tables (generated by mksyntax) are
133 used to classify characters during lexical analysis. There are
134 three tables: one for normal use, one for use when inside single
135 quotes, and one for use when inside double quotes. The tables
136 are machine dependent because they are indexed by character vari-
137 ables and the range of a char varies from machine to machine.
138
139 PARSE OUTPUT: The output of the parser consists of a tree of
140 nodes. The various types of nodes are defined in the file node-
141 types.
142
143 Nodes of type NARG are used to represent both words and the con-
144 tents of here documents. An early version of ash kept the con-
145 tents of here documents in temporary files, but keeping here do-
146 cuments in memory typically results in significantly better per-
147 formance. It would have been nice to make it an option to use
148 temporary files for here documents, for the benefit of small
149 machines, but the code to keep track of when to delete the tem-
150 porary files was complex and I never fixed all the bugs in it.
151 (AT&T has been maintaining the Bourne shell for more than ten
152 years, and to the best of my knowledge they still haven't gotten
153 it to handle temporary files correctly in obscure cases.)
154
155 The text field of a NARG structure points to the text of the
156 word. The text consists of ordinary characters and a number of
157 special codes defined in parser.h. The special codes are:
158
159 CTLVAR Variable substitution
160 CTLENDVAR End of variable substitution
161 CTLBACKQ Command substitution
162 CTLBACKQ|CTLQUOTE Command substitution inside double quotes
163 CTLESC Escape next character
164
165 A variable substitution contains the following elements:
166
167 CTLVAR type name '=' [ alternative-text CTLENDVAR ]
168
169 The type field is a single character specifying the type of sub-
170 stitution. The possible types are:
171
172 VSNORMAL $var
173 VSMINUS ${var-text}
174 VSMINUS|VSNUL ${var:-text}
175 VSPLUS ${var+text}
176 VSPLUS|VSNUL ${var:+text}
177 VSQUESTION ${var?text}
178 VSQUESTION|VSNUL ${var:?text}
179 VSASSIGN ${var=text}
180 VSASSIGN|VSNUL ${var=text}
181
182 In addition, the type field will have the VSQUOTE flag set if the
183 variable is enclosed in double quotes. The name of the variable
184 comes next, terminated by an equals sign. If the type is not
185 VSNORMAL, then the text field in the substitution follows, ter-
186 minated by a CTLENDVAR byte.
187
188 Commands in back quotes are parsed and stored in a linked list.
189 The locations of these commands in the string are indicated by
190 CTLBACKQ and CTLBACKQ+CTLQUOTE characters, depending upon whether
191 the back quotes were enclosed in double quotes.
192
193 The character CTLESC escapes the next character, so that in case
194 any of the CTL characters mentioned above appear in the input,
195 they can be passed through transparently. CTLESC is also used to
196 escape '*', '?', '[', and '!' characters which were quoted by the
197 user and thus should not be used for file name generation.
198
199 CTLESC characters have proved to be particularly tricky to get
200 right. In the case of here documents which are not subject to
201 variable and command substitution, the parser doesn't insert any
202 CTLESC characters to begin with (so the contents of the text
203 field can be written without any processing). Other here docu-
204 ments, and words which are not subject to splitting and file name
205 generation, have the CTLESC characters removed during the vari-
206 able and command substitution phase. Words which are subject
207 splitting and file name generation have the CTLESC characters re-
208 moved as part of the file name phase.
209
210 EXECUTION: Command execution is handled by the following files:
211 eval.c The top level routines.
212 redir.c Code to handle redirection of input and output.
213 jobs.c Code to handle forking, waiting, and job control.
214 exec.c Code to to path searches and the actual exec sys call.
215 expand.c Code to evaluate arguments.
216 var.c Maintains the variable symbol table. Called from expand.c.
217
218 EVAL.C: Evaltree recursively executes a parse tree. The exit
219 status is returned in the global variable exitstatus. The alter-
220 native entry evalbackcmd is called to evaluate commands in back
221 quotes. It saves the result in memory if the command is a buil-
222 tin; otherwise it forks off a child to execute the command and
223 connects the standard output of the child to a pipe.
224
225 JOBS.C: To create a process, you call makejob to return a job
226 structure, and then call forkshell (passing the job structure as
227 an argument) to create the process. Waitforjob waits for a job
228 to complete. These routines take care of process groups if job
229 control is defined.
230
231 REDIR.C: Ash allows file descriptors to be redirected and then
232 restored without forking off a child process. This is accom-
233 plished by duplicating the original file descriptors. The redir-
234 tab structure records where the file descriptors have be dupli-
235 cated to.
236
237 EXEC.C: The routine find_command locates a command, and enters
238 the command in the hash table if it is not already there. The
239 third argument specifies whether it is to print an error message
240 if the command is not found. (When a pipeline is set up,
241 find_command is called for all the commands in the pipeline be-
242 fore any forking is done, so to get the commands into the hash
243 table of the parent process. But to make command hashing as
244 transparent as possible, we silently ignore errors at that point
245 and only print error messages if the command cannot be found
246 later.)
247
248 The routine shellexec is the interface to the exec system call.
249
250 EXPAND.C: Arguments are processed in three passes. The first
251 (performed by the routine argstr) performs variable and command
252 substitution. The second (ifsbreakup) performs word splitting
253 and the third (expandmeta) performs file name generation. If the
254 "/u" directory is simulated, then when "/u/username" is replaced
255 by the user's home directory, the flag "didudir" is set. This
256 tells the cd command that it should print out the directory name,
257 just as it would if the "/u" directory were implemented using
258 symbolic links.
259
260 VAR.C: Variables are stored in a hash table. Probably we should
261 switch to extensible hashing. The variable name is stored in the
262 same string as the value (using the format "name=value") so that
263 no string copying is needed to create the environment of a com-
264 mand. Variables which the shell references internally are preal-
265 located so that the shell can reference the values of these vari-
266 ables without doing a lookup.
267
268 When a program is run, the code in eval.c sticks any environment
269 variables which precede the command (as in "PATH=xxx command") in
270 the variable table as the simplest way to strip duplicates, and
271 then calls "environment" to get the value of the environment.
272 There are two consequences of this. First, if an assignment to
273 PATH precedes the command, the value of PATH before the assign-
274 ment must be remembered and passed to shellexec. Second, if the
275 program turns out to be a shell procedure, the strings from the
276 environment variables which preceded the command must be pulled
277 out of the table and replaced with strings obtained from malloc,
278 since the former will automatically be freed when the stack (see
279 the entry on memalloc.c) is emptied.
280
281 BUILTIN COMMANDS: The procedures for handling these are scat-
282 tered throughout the code, depending on which location appears
283 most appropriate. They can be recognized because their names al-
284 ways end in "cmd". The mapping from names to procedures is
285 specified in the file builtins, which is processed by the mkbuil-
286 tins command.
287
288 A builtin command is invoked with argc and argv set up like a
289 normal program. A builtin command is allowed to overwrite its
290 arguments. Builtin routines can call nextopt to do option pars-
291 ing. This is kind of like getopt, but you don't pass argc and
292 argv to it. Builtin routines can also call error. This routine
293 normally terminates the shell (or returns to the main command
294 loop if the shell is interactive), but when called from a builtin
295 command it causes the builtin command to terminate with an exit
296 status of 2.
297
298 The directory bltins contains commands which can be compiled in-
299 dependently but can also be built into the shell for efficiency
300 reasons. The makefile in this directory compiles these programs
301 in the normal fashion (so that they can be run regardless of
302 whether the invoker is ash), but also creates a library named
303 bltinlib.a which can be linked with ash. The header file bltin.h
304 takes care of most of the differences between the ash and the
305 stand-alone environment. The user should call the main routine
306 "main", and #define main to be the name of the routine to use
307 when the program is linked into ash. This #define should appear
308 before bltin.h is included; bltin.h will #undef main if the pro-
309 gram is to be compiled stand-alone.
310
311 CD.C: This file defines the cd and pwd builtins. The pwd com-
312 mand runs /bin/pwd the first time it is invoked (unless the user
313 has already done a cd to an absolute pathname), but then
314 remembers the current directory and updates it when the cd com-
315 mand is run, so subsequent pwd commands run very fast. The main
316 complication in the cd command is in the docd command, which
317 resolves symbolic links into actual names and informs the user
318 where the user ended up if he crossed a symbolic link.
319
320 SIGNALS: Trap.c implements the trap command. The routine set-
321 signal figures out what action should be taken when a signal is
322 received and invokes the signal system call to set the signal ac-
323 tion appropriately. When a signal that a user has set a trap for
324 is caught, the routine "onsig" sets a flag. The routine dotrap
325 is called at appropriate points to actually handle the signal.
326 When an interrupt is caught and no trap has been set for that
327 signal, the routine "onint" in error.c is called.
328
329 OUTPUT: Ash uses it's own output routines. There are three out-
330 put structures allocated. "Output" represents the standard out-
331 put, "errout" the standard error, and "memout" contains output
332 which is to be stored in memory. This last is used when a buil-
333 tin command appears in backquotes, to allow its output to be col-
334 lected without doing any I/O through the UNIX operating system.
335 The variables out1 and out2 normally point to output and errout,
336 respectively, but they are set to point to memout when appropri-
337 ate inside backquotes.
338
339 INPUT: The basic input routine is pgetc, which reads from the
340 current input file. There is a stack of input files; the current
341 input file is the top file on this stack. The code allows the
342 input to come from a string rather than a file. (This is for the
343 -c option and the "." and eval builtin commands.) The global
344 variable plinno is saved and restored when files are pushed and
345 popped from the stack. The parser routines store the number of
346 the current line in this variable.
347
348 DEBUGGING: If DEBUG is defined in shell.h, then the shell will
349 write debugging information to the file $HOME/trace. Most of
350 this is done using the TRACE macro, which takes a set of printf
351 arguments inside two sets of parenthesis. Example:
352 "TRACE(("n=%d0, n))". The double parenthesis are necessary be-
353 cause the preprocessor can't handle functions with a variable
354 number of arguments. Defining DEBUG also causes the shell to
355 generate a core dump if it is sent a quit signal. The tracing
356 code is in show.c.