Introduction

Projects

Useful research tools

The authors

The history of Go

Installing Go

Go basics

A key-value server

A "hello world" web server

A "hello world" web server with Chi

Creating an in-memory hash table API

Conclusion

Testing a key-value server

What kinds of testing exist?

A unit test for the JSON function

Parallel tests

Benchmarks

Integration testing

Further testing types

Distributed key-value server

Consensus

Using Raft

Changes to the server

Connecting the servers

Keeping data in sync

Testing

Distributed Key Value Server

Monitoring

Two types of monitoring

Logging

Tracing

Alerting

A canary deployment server

Wait, what's a load balancer?

What aren't we doing?

So what will we be doing?

A basic random-per-request load balancer

Round robin load balancer

Configuration server

Other considerations

Open source load balancers

Chat server

Chatting about chat servers

What features don't we want (yet)?

What features do we want?

How do we want to store our chat history?

Our API

Writing the chat frontend

Deploying

Future improvements

Future thinking

Project ideas

Areas of more research

golang

In this book we will show you the some of the concerns of backend web development through the lens of Go.

It is taught by Nat Welch (formerly an SRE at Google) and Steve McCarthy (Etsy), two Go developers who have been writing software for more than 25 years combined.

In the course, we'll be covering the creation and concerns of a number of fundamental backend building blocks or larger applications:

- A key value server, including the use of distributed consensus algorithms
- A canary deployment server
- A real time chat service
- Testing and monitoring

Regardless of your background, Go can make you a _better backend developer_, but learning Go is challenging because the language looks simple on the outside, but you won't get its full benefit unless you know what it can _really_ do. 

**By the end of the first chapter, you'll already _have built a key-value server reminiscent of similar systems like Redis and memcached._** The subsequent chapters will dive into more hands-on projects and Go concepts including:

- How to test your Go systems with unit tests and integration tests
- **Project**: create a **distributed version of the key-value server** in order to solve the typical problems of server systems such as _node failure_
- How to solve the **problem of "consensus"** in distributed Go systems
- How to write code to **keep data in sync** when running a system for servers located around the globe
- Implementing **black box and white box monitoring** systems for Go servers
- **Project**: building a **load balancer server** from scratch
- Why and how to implement a **canary deployment server** for bug-free gradual deployments
- How to build a **configuration server** to allow zero-downtime deploys 
- Understanding the various tradeoffs in the **design decisions** for Go server systems
- **Project**: build a Go chat server system from the ground up 
- **Database modeling** for backend development as part of your chat server project
- **and a lot more**...

## A Key-Value Server Like Redis And Memcached

n the early chapters of the book we learn how to build a Golang version of a key-value server that works in a manner similar to Redis and Memcached. You'll implement each of these features in Go:

- set and retrieve values by key
- adding persistent storage
- using data encodings such as `JSON` and `base64`
- testing the server with unit tests and integration tests

In these chapters, we also learn how to build a more advanced solution for the problem: **a distributed version of the key-value server**. You will learn how to use **consensus algorithms** in Go to solve the problem of keeping distributed servers in sync. The solid grounding you get in programming Go in these first chapters readies you for more complex Go projects.

## A Real-Time Chat Service

A real-time chat server implemented in Go gives you the opportunity to bring together systems thinking as well as concerns common for web apps:

- relational data modeling with SQL
- authentication
- implementing RESTful resources

Working through this comprehensive project will give you **a high degree of confidence about using Go to implement a huge project from scratch**. You will feel ready to use Go with relational databases such as PostgreSQL or MySQL, and databases in general.

## A Canary Deployment Server And Load Balancer

The work you do in the chapters covering building a canary deployment server and load balancer will open your eyes to the full power of Go. Gradual deployments are a commonly used strategy for code deployments, and the projects you build in these chapters get you familiar with building this kind of **infrastructure software**. 

Your load balancer will implement _random-per-request_ as well as _round-robin_ load balancing. These projects will give you a thorough immersion in systems problem solving with Go. You'll be able to show off your skills on bold projects of your own, in job interviews, and on the job when collaborating with colleagues.

## This book is the _fastest_ way to learn modern backend Go development

With _The newline Guide to Reliable Webservers with Go_, you won't waste time reading shallow blog posts that can't go beyond showing you the simplest Go examples or Todo apps. Instead, **within the first chapter** you'll be well on your way to creating a **Redis-like key-value server**, and the complexity of the systems you're able to build only accelerates from there.

This book opens the door to **more effective backend development** and utilizing the full power of Golang for **microservices**. As Go transforms the systems development landscape, you can use this book and the skills it teaches you to contribute to a faster, more effective systems development experience for your team.

With _The newline Guide to Reliable Webservers with Go_ you can **go from novice to proficiency in Go in a predictable way, without wasting time, and without picking up bad Go coding habits**.

So grab a copy now to advance your journey with Go.

In this book we show important concepts in backend web development through the lens of Go.

Reliable Webservers with Go

The importance of testing your web servers

How to apply distributed consensus algorithms to your key value server

There are a lot of good load balancers written in Go which could give more inspiration for improvements to this system.

---
title: "Open source load balancers"
# description: desc
# privateVideoUrl: url
---

# Open source load balancers

There are a lot of good load balancers written in Go which could give more inspiration for improvements to this system.

Learn

The newline Guide to Building Your First GraphQL Server with Node and TypeScript

Teach

Amelia Wattenberger

Author of Fullstack D3

Community

Featured Podcast

A Software Engineer's Guide to Venture Capital with AngelList Engineer Sumukh Sridhara

Reliable Webservers with Go

Welcome: Introduction

Introduction:

Start Here

Module 0: Introduction

Lesson 1:

Introduction

Lesson 2:

Projects

Lesson 3:

Useful research tools

Lesson 4:

The authors

Lesson 5:

The history of Go

Lesson 6:

Installing Go

Lesson 7:

Go basics

Module 1: A key-value server

Lesson 1:

A key-value server

Lesson 2:

A "hello world" web server

Lesson 3:

A "hello world" web server with Chi

Lesson 4:

Creating an in-memory hash table API

Lesson 5:

Conclusion

Module 2: Testing a key-value server

Lesson 1:

Testing a key-value server

Lesson 2:

What kinds of testing exist?

Lesson 3:

A unit test for the JSON function

Lesson 4:

Parallel tests

Lesson 5:

Benchmarks

Lesson 6:

Integration testing

Lesson 7:

Further testing types

Module 3: Distributed Key Value Server

Lesson 1:

Distributed key-value server

Lesson 2:

Consensus

Lesson 3:

Using Raft

Lesson 4:

Changes to the server

Lesson 5:

Connecting the servers

Lesson 6:

Keeping data in sync

Lesson 7:

Testing

Module 4: Monitoring

Lesson 1:

Monitoring

Lesson 2:

Two types of monitoring

Lesson 3:

Logging

Lesson 4:

Tracing

Lesson 5:

Alerting

Lesson 6: