Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SC-20509 #4

Open
wants to merge 54 commits into
base: add-sematext-exporter
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
7098a62
Start working on structure for logs
AkhigbeEromo Nov 19, 2024
2160a71
Work on logs config
AkhigbeEromo Nov 22, 2024
c0ca7cb
Removed LogStash settings
AkhigbeEromo Nov 22, 2024
9179c5e
This is what our logs config will look like
AkhigbeEromo Nov 22, 2024
915f691
Add queue settings to log config
AkhigbeEromo Nov 22, 2024
3d8390a
Correct Metrics config
AkhigbeEromo Nov 22, 2024
cf6f43e
remove unnecessary things
AkhigbeEromo Nov 22, 2024
e86c09f
complete Logs Endpoint
AkhigbeEromo Nov 22, 2024
02d5643
A lot of experimentation (Still in progress) is being done, so code i…
AkhigbeEromo Nov 27, 2024
a94b20b
Fixed some typos
AkhigbeEromo Nov 28, 2024
ff00870
Another heavy commit
AkhigbeEromo Nov 29, 2024
a8b67a6
First test failed so i had to do some tinkering and refining and put …
AkhigbeEromo Dec 2, 2024
17c525b
Add hostname tag
AkhigbeEromo Dec 3, 2024
e0b95cd
Clean up code
AkhigbeEromo Dec 3, 2024
5cfc6e1
Work on config.go test
AkhigbeEromo Dec 4, 2024
9ad149b
Add tests for logs support part of writer.go
AkhigbeEromo Dec 4, 2024
e999c1f
Write tests for falt_formatter.go
AkhigbeEromo Dec 4, 2024
5303ef0
Fix lint issues
AkhigbeEromo Dec 4, 2024
14d74d2
Fix lint issues
AkhigbeEromo Dec 5, 2024
d3bb694
Remove unnecessary alias
AkhigbeEromo Dec 5, 2024
b31b205
Add mapstructure for write events
AkhigbeEromo Dec 5, 2024
886b1ac
Fix otel issues
AkhigbeEromo Dec 5, 2024
17e4f25
Fix more lint issues
AkhigbeEromo Dec 5, 2024
8260265
Fix CI issues
AkhigbeEromo Dec 5, 2024
75725c0
App token is not being passed as ._index
AkhigbeEromo Dec 6, 2024
4513518
Fix CI issues, removed "custom" from being an option in the regions
AkhigbeEromo Dec 9, 2024
27ceed9
Fix CI issues
AkhigbeEromo Dec 9, 2024
9bd25b1
Fix lint issues
AkhigbeEromo Dec 9, 2024
5035763
Fix CI issues
AkhigbeEromo Dec 9, 2024
ef17936
Update gendistributions
AkhigbeEromo Dec 9, 2024
8bdc051
Remove unnecessary error return value
AkhigbeEromo Dec 9, 2024
11ba415
Make anchor links lowercase
AkhigbeEromo Dec 9, 2024
91c7494
Fix anchor links
AkhigbeEromo Dec 9, 2024
8be0231
Fix anchor link
AkhigbeEromo Dec 9, 2024
cde2d8f
remove links
AkhigbeEromo Dec 9, 2024
ddd7911
Write more unit tests
AkhigbeEromo Dec 10, 2024
7b06688
Remove unused prameter
AkhigbeEromo Dec 10, 2024
5978836
Fix lint issues
AkhigbeEromo Dec 12, 2024
acfa996
Implement fix that Akshat suggested
AkhigbeEromo Dec 18, 2024
7bc9caf
Correct endpoints
AkhigbeEromo Dec 18, 2024
d4a6453
Fix lint issues
AkhigbeEromo Dec 18, 2024
1fbb2bc
Remove getHostName
AkhigbeEromo Dec 19, 2024
b0c1208
Remove deprecated library
AkhigbeEromo Dec 23, 2024
f087bd5
Replace logrus with zap
AkhigbeEromo Dec 23, 2024
748519a
Fix lint issues
AkhigbeEromo Dec 23, 2024
8c698d3
Add more tests
AkhigbeEromo Dec 24, 2024
de4f331
Remove logrus
AkhigbeEromo Dec 27, 2024
63406b6
Handle errors
AkhigbeEromo Dec 27, 2024
814b006
Fix issue with writer
AkhigbeEromo Dec 27, 2024
032d36e
Remove flatwriter
AkhigbeEromo Dec 27, 2024
3f84e20
Fix lint issues
AkhigbeEromo Dec 27, 2024
5e33287
Remove unnecessary things from exporter
AkhigbeEromo Dec 27, 2024
bad6f1a
Trim Noisy Tags
AkhigbeEromo Jan 8, 2025
4d96cfa
Fix lint issues
AkhigbeEromo Jan 9, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add tests for logs support part of writer.go
  • Loading branch information
AkhigbeEromo committed Dec 4, 2024
commit 9ad149b469c4d976ae4984836edd9be753e7d470
80 changes: 80 additions & 0 deletions exporter/sematextexporter/writer_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -10,12 +10,14 @@ import (
"sync"
"testing"
"time"
"bytes"

"github.com/influxdata/influxdb-observability/common"
"github.com/influxdata/line-protocol/v2/lineprotocol"
"github.com/stretchr/testify/assert"
"github.com/stretchr/testify/require"
"go.opentelemetry.io/collector/component/componenttest"
"github.com/sirupsen/logrus"
)

func TestSematextHTTPWriterBatchOptimizeTags(t *testing.T) {
Expand Down Expand Up @@ -219,3 +221,81 @@ func TestComposeWriteURLDoesNotPanic(t *testing.T) {
assert.NoError(t, err)
})
}
func TestNewFlatWriter(t *testing.T) {
config := &Config{
LogsConfig: LogsConfig{
LogMaxAge: 7,
LogMaxBackups: 5,
LogMaxSize: 10,
},

}
writer, err := NewFlatWriter("test.log", config)
assert.NoError(t, err)
assert.NotNil(t, writer)
assert.NotNil(t, writer.l)
}
func TestFlatWriterWrite(t *testing.T) {
var buf bytes.Buffer
logger := logrus.New()
logger.SetOutput(&buf)
writer := &FlatWriter{l: logger}

message := "test message"
writer.Write(message)

assert.Contains(t, buf.String(), message)
}
func TestInitRotate(t *testing.T) {
hook, err := InitRotate("test.log", 7, 5, 10, &FlatFormatter{})
assert.NoError(t, err)
assert.NotNil(t, hook)
}
func TestNewRotateFile(t *testing.T) {
config := RotateFileConfig{
Filename: "test.log",
MaxSize: 10,
MaxBackups: 5,
MaxAge: 7,
Level: logrus.InfoLevel,
Formatter: &FlatFormatter{},
}

hook, err := NewRotateFile(config)
assert.NoError(t, err)
assert.NotNil(t, hook)
}
func TestRotateFileFire(t *testing.T) {
var buf bytes.Buffer

hook := &RotateFile{
Config: RotateFileConfig{
Filename: "test.log",
MaxSize: 10,
MaxBackups: 5,
MaxAge: 7,
Level: logrus.InfoLevel,
Formatter: &logrus.TextFormatter{},
},
logWriter: &buf,
}

entry := &logrus.Entry{
Message: "test entry",
Level: logrus.InfoLevel,
}

err := hook.Fire(entry)
assert.NoError(t, err)
assert.Contains(t, buf.String(), "test entry")
}
func TestRotateFileLevels(t *testing.T) {
hook := &RotateFile{
Config: RotateFileConfig{
Level: logrus.WarnLevel,
},
}

expectedLevels := logrus.AllLevels[:logrus.WarnLevel+1]
assert.Equal(t, expectedLevels, hook.Levels())
}