You signed in with another tab or window.Reload to refresh your session.You signed out in another tab or window.Reload to refresh your session.You switched accounts on another tab or window.Reload to refresh your session.Dismiss alert
tlparse parses structured torch trace logs and outputs HTML files analyzing data.
Quick start:Run PT2 with the TORCH_TRACE environment variable set:
TORCH_TRACE=/tmp/my_traced_log_dir example.py
Feed input into tlparse:
tlparse /tmp/my_traced_log_dir -o tl_out/
Adding custom parsers
You can extend tlparse with custom parsers which take existing structured log data and output any file. To do so, first implement StructuredLogParser with your own trait:
pubstructMyCustomParser;implStructuredLogParserforMyCustomParser{fnname(&self) ->&'staticstr{"my_custom_parser"}fnget_metadata<'e>(&self,e:&'eEnvelope) ->Option<Metadata<'e>>{// Get required metadata from the Envelope.// You'll need to update Envelope with your custom Metadata if you need new types here ....}fnparse<'e>(&self,lineno:usize,metadata:Metadata<'e>,_rank:Option<u32>,compile_id:&Option<CompileId>,payload:&str) -> anyhow::Result<ParserResult>{// Use the metadata and payload however you'd like// Return either a ParserOutput::File(filename, payload) or ParserOutput::Link(name, url)}}
How to release
Make a release commit by updating Cargo.toml and then running cargo update
Push the release commit and a tag for it. This will trigger PyPI release