Research2h ago
Apple Scales Categorical Flow Maps For Language
Apple researchers developed Categorical Flow Maps to generate discrete language data using continuous flow matching. This method replaces traditional autoregressive sampling with a process that maps Gaussian noise to one-hot encoded distributions. It enables faster sampling and tilting. Practitioners can now explore non-autoregressive alternatives for language modeling that mirror the efficiency of continuous image generation.