mLalush

u/mLalush


r/MachineLearning•

easyaligner

I have built easyaligner, a forced alignment library designed to be performant and easy to use.

Having worked with preprocessing hundreds of thousands of hours of audio and text for training speech-to-text models, I found that the available open source forced alignment libraries often missed some convenience features. For our purposes it was, in particular, important for the tooling to be able to:

  • Handle cases where the transcript does not cover all of the spoken content in the audio (by automatically detecting the relevant audio region).
  • Ha
2010

r/MachineLearning•

I've come across several papers where authors mention they, for reasons of computational efficiency, will pack multiple shorter training examples together in a single sequence.

Example from "Scaling Instruction-Finetuned Language Models" (Chung et al, 2022):

We use packing (Raffel et al., 2020) to combine multiple training examples into a single sequence, separating inputs from targets using an end-of-sequence token. Masking is applied to prevent the tokens from attending to others across the packed example boundary.

I'm curious to understand how this is actually done in practice. Seeing as multiple separate masks are involved, I'd think one woul

45

r/MachineLearning•

In image classification, early standards generally had users divide image files into different training and validation folders, as well as (sometimes) requiring separate folders for each class label. While researchers seem to have held on to these standards, the APIs of deep learning libraries eventually evolved to allow more flexible usage which didn't necessarily require users to shuffle around image files in folders should they want to adjust their training and validation setups.

Keeping training and validation files in different folders probably has certain benefits for the reproducibility of research, namely in making it abundantly clear how the train/val split was performed. However

21

r/statistics•

I would like to know how r/statistics deals with adding rows/columns to matrices when writing pseudocode. I know there are no definitive pseudocode standards or conventions. From what I have seen mostly objects are defined as sets, and you use the union symbol to add elements to that set.

However, how do you go about it when you wish to make abundantly clear that an object that is being appended to is a matrix? Do you just write .append() or rbind() and describe what the procedure does?

I would appreciate if someone has examples of pseudocode they or others have written which deal with these kind of ambiguities in a clear way.

77

r/statistics•

I have used bootstrap to train multiple models and evaluate them on the observations which were not included in each bootstrap sample. I wanted to report the uncertainty of my evaluation measure P. The number of bootstrap runs were around 100, so instead of reporting percentiles I've opted for standard error (or deviation?).

Let's say I have B bootstrap runs. For each bootstrap sample b I evaluate the precision (evaluation measure) of my test data predictions, let's denote this P_b. This is what I'm estimating from the samples.

I then calculate the standard error sqrt(1/(B-1) * sum((P - mean(P))^2) ) (imagine this as vectorised R code with P now a vector containing B precis

94