Earlier this year I wrote a post about implementing BPE tokenization in Go,
which made it possible to reproduce OpenAI's tokenizer.
Today I want to mention a new project I've been hacking on recently:
go-sentencepiece
- a pure Go implementation of the SentencePiece tokenizer
that...
Introduction:
Welcome to Episode 5 of our Intro to Generative AI series! In this episode, Daniel explores practical techniques for enhancing AI models’ ability to handle large volumes of text data effectively. He addresses the challenges developers face when working with ex...
A description of range over function types, a new feature in Go 1.23.
#519 — August 20, 2024
Unsub | Web Version
🏖️ If you missed last week's issue, don't worry - you didn't. I took a week off for a summer break, but now we're back ;-) Thanks to everyone who sent in links for us to check out.__Peter Cooper, your...
It was my first GopherCon, and I had a great time. There were some great talks, great people, great food, some great swag and a very perfectly chosen hotel!
I'd wanted to go last year, but it was my first week at Elastic, and I don't think it would've been a good look 🫣
You'll...
A new set of Microsoft Go builds is now available for download.
The post Go 1.23.0-1 Microsoft build now available appeared first on Microsoft for Go Developers.
AES is an amazing, state-of-the-art encryption system, and it’s built right
in to Go as part of the standard library. It’s also incredibly easy to use.
Let’s see how!
TL;DR: Go now officially supports ranging over function iterators, adds opt-in telemetry, is WAY faster when building with Profiled Guided Optimization enabled, fixes garbage collection of tickers and timers, and provides useful updates to many packages of the standard library. G...