You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I experimented with hardcoded splitting - it works but I was thinking of instructing openAI to basically split up the text in manageable chunks.
I would suggest to have some overlap and make it aware of the previous chunk.
This might also be an over-engineered solution proposition for code (I think it works better for website crawled via Puppeteer due to superfluous text of repeating menus, etc.). Keen to hear your thoughts though.
The text was updated successfully, but these errors were encountered:
I experimented with hardcoded splitting - it works but I was thinking of instructing openAI to basically split up the text in manageable chunks.
I would suggest to have some overlap and make it aware of the previous chunk.
This might also be an over-engineered solution proposition for code (I think it works better for website crawled via Puppeteer due to superfluous text of repeating menus, etc.). Keen to hear your thoughts though.
The text was updated successfully, but these errors were encountered: