langml.baselines.matching.sbert.dataloder

Module Contents

Classes

DataLoader

TFDataLoader

class langml.baselines.matching.sbert.dataloder.DataLoader(data: List, tokenizer: object, batch_size: int = 32)[source]

Bases: langml.baselines.BaseDataLoader

__len__(self) → int[source]
static load_data(fpath: str, build_vocab: bool = False, label2idx: Optional[Dict] = None) → Union[List[Tuple[str, str, int]], Tuple[List[Tuple[str, str, int]], Dict]][source]
Parameters

  • fpath – str, path of data

  • build_vocab – bool, whether to build vocabulary

  • label2idx – Optional[Dict], label to index dict

make_iter(self, random: bool = False)[source]
class langml.baselines.matching.sbert.dataloder.TFDataLoader(data: List, tokenizer: object, batch_size: int = 32)[source]

Bases: DataLoader

make_iter(self, random: bool = False)[source]
__call__(self, random: bool = False)[source]