Skip to content

Latest commit

 

History

History
 
 

asdl

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
NOTES.txt
NOTES.txt
 
 
README.md
README.md
 
 
__init__.py
__init__.py
 
 
asdl_.py
asdl_.py
 
 
asdl_demo.py
asdl_demo.py
 
 
const.py
const.py
 
 
format.py
format.py
 
 
format_test.py
format_test.py
 
 
front_end.py
front_end.py
 
 
front_end_test.py
front_end_test.py
 
 
gen_cpp.py
gen_cpp.py
 
 
gen_python.py
gen_python.py
 
 
gen_python_test.py
gen_python_test.py
 
 
meta.py
meta.py
 
 
pretty.py
pretty.py
 
 
run.sh
run.sh
 
 
runtime.py
runtime.py
 
 
tdop.py
tdop.py
 
 
tdop_lexer.py
tdop_lexer.py
 
 
typed_arith.asdl
typed_arith.asdl
 
 
typed_arith_abbrev.py
typed_arith_abbrev.py
 
 
typed_arith_demo.cc
typed_arith_demo.cc
 
 
typed_arith_parse.py
typed_arith_parse.py
 
 
typed_arith_parse_test.py
typed_arith_parse_test.py
 
 
typed_demo.asdl
typed_demo.asdl
 
 
typed_demo.py
typed_demo.py
 
 
visitor.py
visitor.py
 
 

README.md

Zephyr ASDL

This directory contains an implementation of Zephyr ASDL. It consists of these components:

  • asdl.py: the ASDL schema parser, borrowed from Python (Python-3.5.2/Parser/asdl.py)
  • py_meta.py: library to dynamically generate Python classes (using metaclasses)
  • encode.py: library to encode ASDL data structures in oheap format (to be described later)
  • gen_cpp.py: tool to generate C++ code to read the oheap format

This library will be used for serializing parsed osh and oil code.

The files arith_parse.py, arith.asdl, arith_ast.py, and arith_demo.cc are an end-to-end demo, driven by run.sh.

For more on Zephyr ASDL, see this blog post.

OHeap

This is an experimental serialization of ASDL data structures. See What is OHeap?

On Ubuntu:

build/codegen.sh download-clang     
build/codegen.sh extract-clang     

# encodes and decodes arithmetic AST
asdl/run.sh asdl-arith-oheap

# encodes and decodes the OSH "lossless syntax tree"
asdl/run.sh osh-demo

(NOTE: We probably shouldn't require Clang for this? It's only necessary for ASAN, clang-format, build time benchmarking, runtime benchmarking vs. GCC, etc.)

OHeap Use Cases:

  • To freeze OSH LSTs (instances of types in osh.asdl)
    • This isn't necessary if the parser is fast enough (which is desirable)
  • To freeze Python / OPy bytecode, and associated constants
    • Special case: ASDL reflection data for osh.asdl, so we can pretty print them