SentencePiece BPE Tokenizer in Go

Earlier this year I wrote a post about implementing BPE tokenization in Go, which made it possible to reproduce OpenAI's tokenizer. Today I want to mention a new project I've been hacking on recently: go-sentencepiece - a pure Go implementation of the SentencePiece tokenizer that...

Ep. 5: Key Techniques for Accurate AI-Driven Information Retrieval

Introduction: Welcome to Episode 5 of our Intro to Generative AI series! In this episode, Daniel explores practical techniques for enhancing AI models’ ability to handle large volumes of text data effectively. He addresses the challenges developers face when working with ex...

It's not simple to add function keyword arguments to Go

Range Over Function Types

A description of range over function types, a new feature in Go 1.23.

The GopherCon UK experience

#​519 — August 20, 2024 Unsub  |  Web Version 🏖️ If you missed last week's issue, don't worry - you didn't. I took a week off for a summer break, but now we're back ;-) Thanks to everyone who sent in links for us to check out.__Peter Cooper, your...

A downside or two of function keyword arguments (and default values)

GopherCon UK 2024

It was my first GopherCon, and I had a great time. There were some great talks, great people, great food, some great swag and a very perfectly chosen hotel! I'd wanted to go last year, but it was my first week at Elastic, and I don't think it would've been a good look 🫣 You'll...

Go 1.23.0-1 Microsoft build now available

A new set of Microsoft Go builds is now available for download. The post Go 1.23.0-1 Microsoft build now available appeared first on Microsoft for Go Developers.

Encrypting with AES

AES is an amazing, state-of-the-art encryption system, and it’s built right in to Go as part of the standard library. It’s also incredibly easy to use. Let’s see how!

Go One-Two-Three: My Favorite Features of Go Release 1.23

TL;DR: Go now officially supports ranging over function iterators, adds opt-in telemetry, is WAY faster when building with Profiled Guided Optimization enabled, fixes garbage collection of tickers and timers, and provides useful updates to many packages of the standard library. G...