With the Racket 8.7
release, Typed Racket includes two languages that
weaken the run-time behavior of types: Shallow Typed Racket and Optional Typed Racket.
Whereas normal Typed Racket types (Deep types) enforce guarantees that any module
can depend on, Shallow types enforce only local invariants in typed code, and
Optional types enforce nothing.
In return, Shallow and Optional types add less overhead to gradual interactions.
Code often runs faster and simpler than with Deep types.
Shallow Typed Racket and Optional Typed Racket use the same static types and typechecker as
normal (Deep) Typed Racket.
1
Background: Typed–Untyped Interaction
A key feature of Typed Racket is that it allows typed code to interact with
untyped code.
An untyped module can import from a typed one with a normal require form,
and a typed module can import from an untyped one by using a require/typed
form:
For example, if an untyped module provides a struct and a function:
then a typed module can import the untyped bindings:
So far so good.
One program combines untyped and typed code.
Now, what if the declared types are wrong?
The module below gives a wrong type to the distance function.
This type expects an integer result instead of a real number:
Even with the wrong type, the program still typechecks (!)
because Typed Racket does not analyze untyped code.
It assumes the require/typed types are correct and moves on.
But this program does have a type error.
At run-time, the call to distance returns a float instead of an integer,
contradicting the static type.
If we want to catch the error, then Typed Racket needs to enforce types at run-time
when typed and untyped code interact.
2
Enforcing Type Boundaries
By default, Typed Racket compiles types to higher-order contracts.
The function type (-> pt pt Integer), for example, compiles to a function
contract that will raise an exception if gets attached to a function that
eventually returns a non-integer result.
Contracts enforce types with strong guarantees and offer useful debugging
information if an error occurs.
But they can also be expensive, especially when large, mutable, or higher-order
values frequently cross boundaries.
These high costs inspired a long search for cheaper ways to enforce types
than the standard Deep strategy.
Two promising alternatives are Shallow and Optional types,
neither of which use higher-order contracts.
Shallow types use lightweight assertions called shape checks to provide
a basic soundness guarantee.
Instead of putting heavy contracts at module boundaries, Shallow Typed Racket rewrites
typed code to incrementally check the shape of values.
Optional types use no checks.
They are completely unreliable for reasoning about typed-untyped interactions.
But, they also have zero cost.
3
How to Select an Enforcement Strategy
The #lang of a Typed Racket module decides how its types
behave at run-time.
To change strategies, change the language.
For a complete list of forms that change depending on the #lang, see
Forms that Depend on the Behavior of Types
in the Typed Racket Reference.
4
Example: Fewer Run-time Checks
Deep types can be significantly more expensive than Shallow and Optional.
For example, the two functions below expect a data structure and access part of the data:
list-first returns the first element of a list
and vec-length counts the number of elements in a vector.
When these functions get called from untyped code, they have very different
costs depending on the behavior of types:
-
Deep types check all incoming data structures exhaustively.
Lists undergo a full traversal that validates every list element, including unused ones.
Vectors get wrapped in a chaperone to guard against future writes.
-
Shallow types check the shape of the incoming data structures using
list? and vector?.
Elements of these structures get checked only when they are used by typed code.
-
Optional types check nothing at all.
Further Reading has links to larger examples where the costs of Deep types
are huge compared to Shallow and Optional.
5
Example: Weaker Types, Simpler Behavior
Shallow and Optional types raise fewer run-time errors than Deep.
In many cases, the lack of an error means that a bug goes undetected.
Deep finds the bug and the other two miss it because they skipped a run-time check.
But for some programs, the Deep types are too cautious.
They reject a program that could run safely.
One restrictive type in the Deep world is Procedure, the type that
describes any function.
Because this type says nothing about argument and return types,
Deep Typed Racket never allows calls to a procedure, even after a cast:
(call-proc identity) |
g4: arity mismatch; |
the expected number of arguments does not match the given |
number |
given: 1 |
Shallow types do allow calls to a Procedure, after a cast:
(call-proc identity) |
- : Symbol |
'hello |
Optional types also allow calls to a Procedure:
(call-proc identity) |
- : Symbol |
'hello |
6
Four-Way Interactions
Typed–untyped interactions are much more exciting now that “typed code” can
be Deep, Shallow, or Optional.
These three styles of typed code can all interact with untyped code (of course),
and they can also interact with one another.
Types in this four-way world need to be enforced at run-time depending on how
they were defined:
-
Deep types get enforced with contracts at all boundaries to non-Deep code.
This means that Deep–Shallow and Deep–Optional interactions can be expensive.
-
Shallow types guard the boundaries to Optional and untyped code with shape checks.
-
Optional types never enforce themselves.
But a Deep-typed or Shallow-typed client of Optional code will insert
run-time checks as a consequence of their strategies.
These checks between Deep, Shallow, and Optional may come as a surprise,
especially because all typed code gets validated by the same static type
checker.
But the checks are necessary because run-time interactions can mix untyped
values into some of these typed modules.
If an Optional module were to import an untyped function and send it to Deep-typed code
without a contract wrapper, it could break the Deep type guarantees.
7
Reflections on Deep, Shallow, and Optional
Deep types, Shallow types, and Optional types have complementary strengths.
When and where does each one work best?
Here are a few suggestions, based on
When to Use Deep, Shallow, or Optional?
from the Typed Racket Guide:
-
Deep types make the most of static checking and optimizations.
Use them for self-sufficient groups of typed modules.
Avoid them at high-traffic boundaries to untyped or to non-Deep code.
-
Shallow types provide a weak but useful soundness guarantee at low cost.
Use them in typed modules that frequently communicate with the untyped world.
Avoid them, however, in large typed modules because every expression in typed
code potentially needs a Shallow shape check.
-
Optional types use types for static analysis and nothing more.
Use them when you do not want types enforced at run-time.
We are very excited to have these languages in the Typed Racket family.
Learning more about where they fit in practical applications and about how
developers tend to use them will be part of the adventure.
8
Further Reading