unorthodox text input

[Vitor-Almeida]

Hi!

If the input of my model is of the following format:
raw_text = "Aaaa Bbbbb Cccc Dddd Eeee Ffff"
input_text = [["Aaaa", "Bbbbb", "Cccc"] , ["Dddd" , "Eeee", "Ffff"]]

So, my input is a list of a list of strings, which essentially represent sentences in a paragraph or text.

It comes from this paper:
https://aclanthology.org/2021.naacl-main.22.pdf

Essentially, it is a way to increase the context size of models like Bert.

Will I be able to tweak the code a little bit and make it work with the library? Or it's something fundamentally different?