de.dante.extex.interpreter.primitives.register.toks
Class ToksPrimitive

java.lang.Object
  extended byde.dante.extex.interpreter.type.AbstractCode
      extended byde.dante.extex.interpreter.type.AbstractAssignment
          extended byde.dante.extex.interpreter.primitives.register.toks.AbstractToks
              extended byde.dante.extex.interpreter.primitives.register.toks.ToksPrimitive
All Implemented Interfaces:
Code, Localizable, java.io.Serializable, Theable, TokensConvertible
Direct Known Subclasses:
ToksParameter

public class ToksPrimitive
extends AbstractToks
implements TokensConvertible, Theable

This class provides an implementation for the primitive \toks. It sets the named tokens register to the value given, and as a side effect all prefixes are zeroed.

The Primitive \toks

The primitive \toks provides access to the named tokens register. token sequences can be stored in them for later use. This means that the tokens do not have to be parsed again. Even a change in the catcode settings does not alter the tokens build once.

The primitive \toks also respects the count register \globaldefs to enable general global assignment.

Since the primitive is classified as assignment the value of \afterassignment is applied.

Syntax

The formal description of this primitive is the following:
    ⟨toks⟩
      → \toks ⟨register name⟩ ⟨equals⟩ ⟨tokens⟩  

In TeX the register name is a number in the range 0 to 255. Extensions to this are defined in eTeX and Omega where the limitation of the range is raised. In ExTeX this limit can be configured. In addition tokens can be used to address named token registers.

Examples

    \toks2={UTF-8}  
    \toks42={UTF-8}  
    \toks42=\toks0  
    \toks{abc}={Hello world}  

Version:
$Revision: 1.20 $
Author:
Gerd Neugebauer, Michael Niedermair
See Also:
Serialized Form

Field Summary
protected static long serialVersionUID
          The constant serialVersionUID contains the id for serialization.
 
Constructor Summary
ToksPrimitive(java.lang.String name)
          Creates a new object.
 
Method Summary
 void assign(Flags prefix, Context context, TokenSource source, Typesetter typesetter)
          The method assign is the core of the functionality of execute().
 Tokens convertTokens(Context context, TokenSource source, Typesetter typesetter)
          This method converts a register into tokens.
protected  void expand(Flags prefix, Context context, TokenSource source, Typesetter typesetter, java.lang.String key)
          Expand
 Tokens the(Context context, TokenSource source, Typesetter typesetter)
          Return the register value as Tokens for \the.
 
Methods inherited from class de.dante.extex.interpreter.primitives.register.toks.AbstractToks
getKey
 
Methods inherited from class de.dante.extex.interpreter.type.AbstractAssignment
execute
 
Methods inherited from class de.dante.extex.interpreter.type.AbstractCode
enableLocalization, getLocalizer, getName, isIf, isOuter, printable, printableControlSequence, readResolve, setName, toString
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Field Detail

serialVersionUID

protected static final long serialVersionUID
The constant serialVersionUID contains the id for serialization.

See Also:
Constant Field Values
Constructor Detail

ToksPrimitive

public ToksPrimitive(java.lang.String name)
Creates a new object.

Parameters:
name - the name for debugging
Method Detail

assign

public void assign(Flags prefix,
                   Context context,
                   TokenSource source,
                   Typesetter typesetter)
            throws InterpreterException
Description copied from class: AbstractAssignment
The method assign is the core of the functionality of execute(). This method is preferable to execute() since the execute() method provided in this class takes care of \afterassignment and \globaldefs as well.

Specified by:
assign in class AbstractAssignment
Parameters:
prefix - the prefix controlling the execution
context - the interpreter context
source - the token source
typesetter - the typesetter
Throws:
InterpreterException - in case of an error
See Also:
Code.execute( de.dante.extex.interpreter.Flags, de.dante.extex.interpreter.context.Context, de.dante.extex.interpreter.TokenSource, de.dante.extex.typesetter.Typesetter)

convertTokens

public Tokens convertTokens(Context context,
                            TokenSource source,
                            Typesetter typesetter)
                     throws InterpreterException
Description copied from interface: TokensConvertible
This method converts a register into tokens. It might be necessary to read further tokens to determine which value to use. For instance an additional register number might be required. In this case the additional arguments Context and TokenSource can be used.

Specified by:
convertTokens in interface TokensConvertible
Parameters:
context - the interpreter context
source - the source for new tokens
typesetter - the typesetter to use for conversion
Returns:
the converted value
Throws:
InterpreterException - in case of an error
See Also:
TokensConvertible.convertTokens( de.dante.extex.interpreter.context.Context, de.dante.extex.interpreter.TokenSource, de.dante.extex.typesetter.Typesetter)

expand

protected void expand(Flags prefix,
                      Context context,
                      TokenSource source,
                      Typesetter typesetter,
                      java.lang.String key)
               throws GeneralException
Expand

Scan the tokens between { and } and store them in the named tokens register.

Parameters:
prefix - the prefix flags
context - the interpreter context
source - the token source
typesetter - the typesetter
key - the key
Throws:
GeneralException - in case of an error

the

public Tokens the(Context context,
                  TokenSource source,
                  Typesetter typesetter)
           throws InterpreterException
Return the register value as Tokens for \the.

Specified by:
the in interface Theable
Parameters:
context - the interpreter context
source - the source for further tokens to qualify the request
typesetter - the typesetter to use
Returns:
the description of the primitive as list of Tokens
Throws:
InterpreterException - in case of an error
See Also:
Theable.the( de.dante.extex.interpreter.context.Context, de.dante.extex.interpreter.TokenSource, Typesetter)