This is the ninth entry of my weekly series Learning Go. Last week I covered How to Write a Recursive Function in Go. This week I am going to talk about Pointers, JSON Marshal and Unmarshal.
Pointers
Although I have heard of pointers in the past, due to coming from JavaScript, this was a completely new territory for me. To define a pointer as simply as I can, a pointer:
"points" to a location in memory where a value is stored
Sounds fairly semantic, right? I have a feeling most would infer this from the word itself; however, there is much more to what a pointer is. Before I jump into using a pointer in Go, let me explain a few important pieces of pointer syntax in Go.
In Go, there are two operators you need to remember when working with pointers:
&
<--- this operator generates an address of the value in memory (generates a pointer)
*
<--- this operator allows you to retrieve the underlying value of the pointer
Note: this is commonly referred to as "Dereferencing"
Let's see an example of both of these operators in action, we will start with the &
operator:
package main
import "fmt"
func main() {
name := "martin"
// & generates an address of the value in memory
fmt.Println(&name)
// 0xc000010200 <--- the address that is generated for the value of name
}
We have created our first pointer!
Let's walk through what is happening here, step-by-step:
name := "martin"
inside of func
main
we declare a variable with the identifier name
with a value of martin
of type string
fmt.Println(&name)
// 0xc000010200
next, using the fmt
package, we print out the address of the value in memory for name
this outputs the following address: 0xc000010200
This might not seem super useful right now, but let me show you how you can use this address to retrieve a value:
package main
import "fmt"
func main() {
name := "martin"
namePointer := &name
fmt.Println("namePointer: ", namePointer)
// namePointer: 0xc000010200
underlyingValue := *namePointer
fmt.Println("underlyingValue: ", underlyingValue)
// underlyingValue: martin
}
Let me walk through what is happening here, line-by-line:
name := "martin"
first, we declare a new variable with an identifier of name
with a value of martin
of type string
namePointer := &name
next, we declare a new variable with an identifier of namePointer
with a value of a pointer to the name
variable
when we print out the value of namePointer
on the next line, we receive this address 0xc000010200
underlyingValue := *namePointer
next, we declare a new variable with an identifier of underlyingValue
, notice we are using the *
operator, this allows us to get the underlying value of a pointer value; therefore, the value of underlyingValue
is the underlying value of namePointer
fmt.Println("underlyingValue: ", underlyingValue)
// underlyingValue: martin
we print out the value of underlyingValue
on the next line and we see that it's value is martin
Pretty cool, huh?
Pointers allow us to store references to data at a low level, their address in memory.
JSON
JSON (JavaScript Object Notation) is a widely used format for sending and receiving data in a wide variety of applications. In Go, it is common practice to use two methods when sending JSON and receiving JSON, Marshal
and Unmarshal
.
Like most things in the Go ecosystem, these functions are named very semantically. Let's look at the definition of Marshal
and Unmarshal
.
Marshal - the process of transforming memory representation of an object to a data format for storage or transmission. This is typically used when data must be moved between different parts of an application.
Essentially, when you use the Marshal
function on data commonly referred to as Marshalling, you are transforming your data into a format that is better suited for storage or for being transmitted to somewhere else in your application.
Unmarshal - the process of transforming a representation of an object that was used for storage or transmission to a representation of the object that is executable
Since it is common practice to Marshal
your JSON data, you can use the Unmarshal
function to transform this data into an executable format (a format you can use in your application).
You can read more about Marshalling and Unmarshalling here.
Let me show you a few examples of using Marshal
and Unmarshal
.
Marshal
package main
import (
"encoding/json"
"fmt"
)
type person struct {
First string
Last string
Age int
}
func main() {
me := person{
First: "martin",
Last: "cartledge",
Age: 29,
}
bff := person{
First: "mikel",
Last: "howarth",
Age: 29,
}
friends := []person{me, bff}
fmt.Println(friends)
// [{martin cartledge 29} {mikel howarth 29}]
res, err := json.Marshal(friends)
// Note: json.Marshal converts your JSON to a string of bytes
if err != nil {
fmt.Println(err)
}
fmt.Println(res)
// [91 123 34 70 105 114 115 116 34 58 34 109 97 114 116 105 110 34 44 34 76 97 115 116 34 58 34 99 97 114 116 108 101 100 103 101 34 44 34 65 103 101 34 58 50 57 125 44 123 34 70 105 114 115 116 34 58 34 109 105 107 101 108 34 44 34 76 97 115 116 34 58 34 104 111 119 97 114 116 104 34 44 34 65 103 101 34 58 50 57 125 93]
}
Let me walk you through what is happening here:
import (
"encoding/json"
"fmt"
)
Inside of package
main
we are now importing the encoding/json
package, this allows us to use the json
package
type person struct {
First string
Last string
Age int
}
Next, we create our own type with the identifier person
of type struct
me := person{
First: "martin",
Last: "cartledge",
Age: 29,
}
We give our person
type three fields: First
of type string
, Last
of type String
, and Age
of type int
Inside of our func
main
, using the short declaration operator, we create a new variable with the identifier me
To assign a value to me
, we use a composite literal of type person
Inside of our composite literal, we assign values to each respective field in our person
type: First
-> martin
, Last
-> cartledge
, and Age
-> 29
bff := person{
First: "mikel",
Last: "howarth",
Age: 29,
}
Next, we create another variable using the short declaration operator with the identifier bff
The value of bff
is also of type person
The values assigned for each respective field for our person
type inside of this composite literal is: First
-> mikel
, Last
-> howarth
, and Age
-> 29
friends := []person{me, bff}
Next, we create a new variable using the short declaration operator with the identifier friends
The value of friends
will be a slice
of type person
, we pass the values of me
and bff
into our composite literal
fmt.Println(friends)
// [{martin cartledge 29} {mikel howarth 29}]
using the fmt
package, we print the value of friends
Quick Note: there are two return values when
json.Marshal
is invoked:1 ) a result
2 ) an error
result is a
slice
of typebyte
([]byte
)error is an
error
res, err := json.Marshal(friends)
For this example, I gave the result the identifier res
, and the error the identifier err
I pass in friends
as the single argument to json.Marshal()
, keep in mind that friends
is a slice
of type person
Quick Note: checking for errors immediately after using Marshal or Unmarshal is considered best practice, this prevents any errors or inconsistencies in your data from trickling into your code
if err != nil {
fmt.Println(err)
}
Next, we check if the value of err
is not nil
, if this evaluates to true
we step inside of this if statement and our error handling code is ran
For this example, we have no errors so the execution of our code continues
fmt.Println(res)
The last line in func
main
uses the fmt
package and logs the value of res
, our newly marshaled data
This is the value of res
post-marshal:
[91 123 34 70 105 114 115 116 34 58 34 109 97 114 116 105 110 34 44 34 76 97 115 116 34 58 34 99 97 114 116 108 101 100 103 101 34 44 34 65 103 101 34 58 50 57 125 44 123 34 70 105 114 115 116 34 58 34 109 105 107 101 108 34 44 34 76 97 115 116 34 58 34 104 111 119 97 114 116 104 34 44 34 65 103 101 34 58 50 57 125 93]
As you can see, we have a slice
of values of type byte
, pretty cool!
Unmarshal
package main
import (
"encoding/json"
"fmt"
)
type person struct {
First string
Last string
Age int
}
func main() {
rawData := `[{"First":"martin","Last":"cartledge","Age":29},{"First":"mikel","Last":"howarth","Age":29}]`
fmt.Println(rawData)
byteString := []byte(rawData)
fmt.Println(byteString)
// people := []person{}
var people []person
err := json.Unmarshal(byteString, &people)
if err != nil {
fmt.Println(err)
}
fmt.Println(people)
for i, v := range people {
fmt.Println("index: ", i)
fmt.Println("First: ", v.First, "Last: ", v.Last, "Age: ", v.Age)
}
}
Let me walk you through what is happening here:
import (
"encoding/json"
"fmt"
)
You will notice that we are importing the encoding/json
package just like we did in our previous example, we need the json
package to use Marshal
and Unmarshal
type person struct {
First string
Last string
Age int
}
We are also creating a new custom type with the identifier person
with three fields: First
of type string
, Last
of type string
, and Age
of type int
rawData := `[{"First":"martin","Last":"cartledge","Age":29},{"First":"mikel","Last":"howarth","Age":29}]`
Using the short declaration operator, I created a new variable with the identifier rawData
and assigned it to a slice
of person
values represented in a JSON string
fmt.Println(rawData)
// [{"First":"martin","Last":"cartledge","Age":29},{"First":"mikel","Last":"howarth","Age":29}]
On the next line, using the fmt
package, we print out the value of rawData
byteString := []byte(rawData)
Next, using the short declaration operator, we declare a new variable with the identifier byteString
, any idea of what we might be doing next?
That's right, we are setting the value of byteString
to a slice
of values of type byte
. This line is complete once we pass the rawData
value into our composite literal
fmt.Println(byteString)
// [91 123 34 70 105 114 115 116 34 58 34 109 97 114 116 105 110 34 44 34 76 97 115 116 34 58 34 99 97 114 116 108 101 100 103 101 34 44 34 65 103 101 34 58 50 57 125 44 123 34 70 105 114 115 116 34 58 34 109 105 107 101 108 34 44 34 76 97 115 116 34 58 34 104 111 119 97 114 116 104 34 44 34 65 103 101 34 58 50 57 125 93]
Using the fmt
package, we print out the value of byteString
var people []person
Using the var
keyword, we create a new variable with the identifier people
that will be a slice
of values of type person
(our custom type we created)
err := json.Unmarshal(byteString, &people)
This is where it gets interesting. Notice that we are assigning only one return value? That is because json.Unmarshal()
takes two arguments, the value you would like to Unmarshal or decode, and a pointer (address in memory) of the variable you would like to assign the Unmarshalled data to.
if err != nil {
fmt.Println(err)
}
Following common convention, next, we immediately check for an error, if we have one we print that error out
Note: depending on your application and the actions you take after you Unmarshal, you might want to stop all execution. I will talk about this in the future post
[{martin cartledge 29} {mikel howarth 29}]
Using the fmt
package, we print out the value of people
. Look at that! Our data is in the same shape as how we started, very cool.
For the sake of using our custom type person
to the fullest, I want to iterate over our newly Unmarshalled data and print out their values
for i, v := range people {
fmt.Println("index: ", i)
fmt.Println("First: ", v.First, "Last: ", v.Last, "Age: ", v.Age)
}
Above, we are using the for
keyword to create a for
statement
This for
loop will return two values, an index
and a value
for each iteration, we assign these values to the variables i
and v
respectively
Inside of the for
loop, using the fmt
package, we print out the value of i
(index
), on the next line we print out the value of each field in our person
type: First
, Last
, and Age
index: 0
First: martin Last: cartledge Age: 29
index: 1
First: mikel Last: howarth Age: 29
Above is our result, pretty cool huh?
In Summary
Go makes creating and reading memory addresses (Pointers
), encoding data (json.Marshal
), and decoding data (json.Unmarshal
) a painless endeavor. Passing data throughout your application is made easier and more performant with the help of these features of the Go programming language. I hope you enjoyed learning about these features, and if you were already familiar with them, I hope you walked away learning something new about them. Next week I will be talking about Sorting Data in Go. See you then, and thanks for reading!