Doesn't fetch reddit pages correctly

[laggingreflex]

When I'm on a reddit page, the info it pulls only contains metadata like community rules etc, not the main discussion - submission text, and the comments.

Test page: https://old.reddit.com/r/askscience/comments/1p1x6e/if_we_know_the_chemical_composition_of_something/

Steps:

1. Goto above page
2. Ask something specific like "what does hydrocarbon mean here"
3. See the RAG-ified citations, they don't contain the submission text nor the comments.
   Only some irrelevant scraps from the page about community rules n such:

   Earth Science, Atmospheric Science, Oceanography, Geology Engineering Mechanical Engineering, Electrical Engineering, Structural Engineering, Computer Engineering, Aerospace Engineering Chemistry Chemistry, Organic Chemistry, Polymers, Biochemistry Social Sciences Social Science, Political Science, Economics, Archaeology, Anthropology, Linguistics

   Please read our guidelines and FAQ before posting * Answer questions with accurate, in-depth explanations, including peer-reviewed sources where possible * Upvote on-topic answers supported by reputable sources and scientific research * Downvote anecdotes, speculation, and jokes * Report comments that do not meet our guidelines, including medical advice * Be civil: Remember the human and follow Reddiquette ### Features

   Theoretical Physics, Experimental Physics, High-energy Physics, Solid-State Physics, Fluid Dynamics, Relativity, Quantum Physics, Plasma Physics Mathematics Mathematics, Statistics, Number Theory, Calculus, Algebra Astronomy Astronomy, Astrophysics, Cosmology, Planetary Formation Computing Computing, Artificial Intelligence, Machine Learning, Computability Earth and Planetary Sciences Earth Science, Atmospheric Science, Oceanography, Geology

   Social Science, Political Science, Economics, Archaeology, Anthropology, Linguistics Biology Biology, Evolution, Morphology, Ecology, Synthetic Biology, Microbiology, Cellular Biology, Molecular Biology, Paleontology Psychology Psychology, Cognitive Psychology, Developmental Psychology, Abnormal, Social Psychology Medicine Medicine, Oncology, Dentistry, Physiology, Epidemiology, Infectious Disease, Pharmacy, Human Body

Great project BTW!

[n4ze3m]

Hey, yes! I will add a parser for Reddit in the coming updates, which will improve the quality of the RAG data