Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[debugtool] parsing the serialized bytes and show its binary structure in yaml format. And vice versa is also helpful. #1727

Open
justincui opened this issue Jul 9, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@justincui
Copy link

Is your feature request related to a problem? Please describe.

I'm always frustrated when debugging serialized data because it's difficult to visualize the binary structure. Understanding the detailed binary layout and content of serialized bytes would greatly enhance debugging and development efficiency.

Describe the solution you'd like

I would like a feature in the Fury debugtool component that can parse serialized bytes and display their binary structure in a human-readable YAML format (with depth control as a parameter). Additionally, the ability to convert the YAML representation back into the original binary format would be extremely helpful for verifying and testing changes during debugging. This bidirectional functionality would provide a robust tool for developers to work seamlessly with serialized data.

Additional context

Implementing this feature would bridge the gap between serialized data and its human-readable representation, making it easier to inspect, debug, and validate serialized objects. It would be particularly useful for developers working with complex data serialization and deserialization processes, enabling them to make changes in YAML and convert them back to binary for testing purposes.

@justincui justincui added the enhancement New feature or request label Jul 9, 2024
@justincui justincui changed the title [<Fury component: debugtool>] parsing the serialized bytes and show its binary structure in yaml format. And vice versa is also helpful. [debugtool] parsing the serialized bytes and show its binary structure in yaml format. And vice versa is also helpful. Jul 9, 2024
@chaokunyang
Copy link
Collaborator

Thanks for propose this feature. This is very useful for debugging. With this feature, we can debug the binary data without the need of deserializing it with the type schema.

This is possible for meta shared compatible mode, Fury write all meta of a class into the binary data. So it's possible to decode the data and print it. We can implement this tool in python for xlang serialization. And for pure java serialization, we need to implement it in java, but it's possible to package this jar into python wheel and build a command line to parse the data using this jar.

For shema consistent mode, it's not possible to parse the bytes since Fury skip write some object meta. So we don't know how to parse the data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants