Parsing json with invalid bytes inside strings on arm64 causes memory corruption

[brennan-airtime]

Tried on:
go: 1.22.x, 1.23.5, 1.23.6
github.com/bytedance/sonic v1.12.2
github.com/bytedance/sonic v1.12.8 (latest at time of writing)

We noticed that we were getting panics running on graviton in aws. Running locally through qemu I see issues with null and newlines inside of json strings when using ConfigDefault.

package main

import (
	"fmt"

	"github.com/bytedance/sonic"
)

type foo struct{}

func main() {
	var bar foo
	s := `{"a":"b
c"}`
	fmt.Println(sonic.ConfigStd.UnmarshalFromString(s, &bar))
	fmt.Println(sonic.Config{ValidateString: true}.Froze().UnmarshalFromString(s, &bar))
	fmt.Println(sonic.ConfigDefault.UnmarshalFromString(s, &bar))
}

Running it a few times every so often I get the signal handler problem. Even when it works obviously the index is way out of bounds so clearly a memory issue.

$ GOARCH=arm64 go run main.go
"Syntax error at index 6: control chars in string\n\n\t{\"a\":\"b\nc\"}\n\t......^....\n"
"Syntax error at index 6: control chars in string\n\n\t{\"a\":\"b\nc\"}\n\t......^....\n"
"Syntax error at index 2113627: expect a `,` or `}`\n\n\t{\"a\":\"b\nc\"}\n\t^\n"
$ GOARCH=arm64 go run ./cmd/foo/main.go
"Syntax error at index 6: control chars in string\n\n\t{\"a\":\"b\nc\"}\n\t......^....\n"
"Syntax error at index 6: control chars in string\n\n\t{\"a\":\"b\nc\"}\n\t......^....\n"
fatal: bad g in signal handler
exit status 2

[liuq19]

thanks, we will fix it

[liuq19]

Fixed by #745