1
0
mirror of https://github.com/netsampler/goflow2.git synced 2024-05-06 15:54:52 +00:00

138 Commits

Author SHA1 Message Date
9f2b0806f0 producer: fix fragment (#214) 2023-09-01 14:41:55 -07:00
bfb23ba283 producer: various improvements (#213)
* feat: add IpFlags field in the protobuf (sFlow and IPFIX populate it)
* fix: fragments parsing from previous commit
* refactor: sflow parsing functions
* feat: decode IPv6 fragment headers
* tests: add producer tests
2023-09-01 14:18:18 -07:00
085e34a85f enricher: add binary marshaller (#212) 2023-08-31 23:27:47 -07:00
8988f2c244 producer: add missing renderer for bgp_next_hop (#210) 2023-08-31 22:31:34 -07:00
026fef546e fix: missing time received ns in netflow v5 (#209)
Co-authored-by: Paweł Mieczkowski <pawel.mieczkowski@redge.com>
2023-08-26 08:52:20 -07:00
a6fe3ffb12 producer: bugfix of sampling mapping for ipfix (#207) 2023-08-23 20:51:54 -07:00
4ad4f9c815 build(deps): bump github.com/libp2p/go-reuseport from 0.3.0 to 0.4.0 (#205)
Bumps [github.com/libp2p/go-reuseport](https://github.com/libp2p/go-reuseport) from 0.3.0 to 0.4.0.
- [Release notes](https://github.com/libp2p/go-reuseport/releases)
- [Commits](https://github.com/libp2p/go-reuseport/compare/v0.3.0...v0.4.0)

---
updated-dependencies:
- dependency-name: github.com/libp2p/go-reuseport
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-21 08:34:25 -07:00
b047aafe15 goflow2: allows using a single port for multiple protocols (sFlow, NetFlow, IPFIX) (#197) 2023-08-14 18:39:56 -07:00
a248b2d458 build: add release container registry workflow (#201) 2023-08-09 22:58:57 -07:00
38290af6af build: add container registry workflow (#200) 2023-08-09 22:47:01 -07:00
6b6d464b38 build: update to go v1.21 (#198) v2.0.0 2023-08-09 20:33:17 -07:00
e8cca7d3fb build(deps): bump github.com/prometheus/client_golang (#193)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.0 to 1.16.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.0...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 20:02:42 -07:00
8fc051af8f build(deps): bump github.com/oschwald/geoip2-golang from 1.8.0 to 1.9.0 (#194)
Bumps [github.com/oschwald/geoip2-golang](https://github.com/oschwald/geoip2-golang) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/oschwald/geoip2-golang/releases)
- [Commits](https://github.com/oschwald/geoip2-golang/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/oschwald/geoip2-golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 20:00:35 -07:00
458e90777f producer: fix fragments (#196) 2023-08-09 19:57:45 -07:00
a705ba8705 build(deps): bump github.com/libp2p/go-reuseport from 0.2.0 to 0.3.0 (#192)
Bumps [github.com/libp2p/go-reuseport](https://github.com/libp2p/go-reuseport) from 0.2.0 to 0.3.0.
- [Release notes](https://github.com/libp2p/go-reuseport/releases)
- [Commits](https://github.com/libp2p/go-reuseport/compare/v0.2.0...v0.3.0)

---
updated-dependencies:
- dependency-name: github.com/libp2p/go-reuseport
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:50 -07:00
2384ca9feb build(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#191)
Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:42 -07:00
9cd0bd38bd build(deps): bump github.com/sirupsen/logrus from 1.9.0 to 1.9.3 (#195)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.0 to 1.9.3.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.0...v1.9.3)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:22 -07:00
ae56e41786 refactor: v2 (#150) 2023-08-09 19:47:20 -07:00
1298b9408d Update issue templates (#189) 2023-08-09 18:19:18 -07:00
2fe21e11f5 Update issue templates (#188) 2023-08-09 18:13:55 -07:00
33c6845301 build(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#183)
Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 17:50:14 -07:00
3a285dce71 build(deps): bump github.com/oschwald/geoip2-golang from 1.8.0 to 1.9.0 (#181)
Bumps [github.com/oschwald/geoip2-golang](https://github.com/oschwald/geoip2-golang) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/oschwald/geoip2-golang/releases)
- [Commits](https://github.com/oschwald/geoip2-golang/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/oschwald/geoip2-golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-22 23:52:06 -07:00
2523abfc9f build(deps): bump github.com/prometheus/client_golang (#180)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-22 23:41:12 -07:00
e5461ee848 build(deps): bump github.com/sirupsen/logrus from 1.9.2 to 1.9.3 (#176)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.2 to 1.9.3.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.2...v1.9.3)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-04 19:25:07 -07:00
dc8d7c5739 build(deps): bump github.com/stretchr/testify from 1.8.3 to 1.8.4 (#177)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.3 to 1.8.4.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.3...v1.8.4)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-04 19:12:49 -07:00
e5696f114b decoders: fix netflow legacy/v5 sampling interval (#171) v1.3.4 2023-05-25 06:10:28 -07:00
e657df6080 build(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3 (#173)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.2 to 1.8.3.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.2...v1.8.3)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Louis <lspgn@users.noreply.github.com>
2023-05-21 20:35:03 -07:00
737140c49d build(deps): bump github.com/sirupsen/logrus from 1.9.0 to 1.9.2 (#174)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.0 to 1.9.2.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.0...v1.9.2)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-21 19:36:28 -07:00
f77d883205 build(deps): bump github.com/prometheus/client_golang (#166)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.0 to 1.15.1.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.0...v1.15.1)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-09 23:36:15 -07:00
ddf5c872e8 build(deps): bump github.com/libp2p/go-reuseport from 0.2.0 to 0.3.0 (#165)
Bumps [github.com/libp2p/go-reuseport](https://github.com/libp2p/go-reuseport) from 0.2.0 to 0.3.0.
- [Release notes](https://github.com/libp2p/go-reuseport/releases)
- [Commits](https://github.com/libp2p/go-reuseport/compare/v0.2.0...v0.3.0)

---
updated-dependencies:
- dependency-name: github.com/libp2p/go-reuseport
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-30 23:07:35 -07:00
69a6eaf99e templates: retrofit to avoid issue when upgrading dep (#160) v1.3.3 2023-04-20 20:05:33 -07:00
e3f58f2564 build(deps): bump github.com/prometheus/client_golang (#159)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.14.0 to 1.15.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.14.0...v1.15.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-20 19:14:32 -07:00
9061d30a79 build(deps): bump google.golang.org/protobuf from 1.29.1 to 1.30.0 (#158)
Bumps google.golang.org/protobuf from 1.29.1 to 1.30.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-20 19:08:48 -07:00
b099a5f313 Create dependabot.yml (#157) 2023-04-20 19:06:44 -07:00
b58874c36a app: hotfix (#156) v1.3.2 2023-04-20 06:46:01 -07:00
958109e91c allow unknown records for sFlow (#155) v1.3.1 2023-04-15 21:21:10 -07:00
5d47e60bed build(deps): bump golang.org/x/net from 0.5.0 to 0.7.0 (#154)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.5.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.5.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-15 21:14:27 -07:00
9850000ffa allow unknown record structures in sFlow (#153) 2023-04-15 20:59:53 -07:00
c4c4ffb4e4 Refactor template as module (#49)
* Refactor template as module
* Abstraction to allow custom template storage (eg: file, redis, http...)
* Works similarly to Transport and Format
v1.3.0
2023-04-15 20:52:32 -07:00
6b3c5f1215 go.mod: update dependencies (#146) v1.2.0 2023-04-15 19:33:39 -07:00
d59f209302 mapping: support endianness (#130) 2023-03-28 22:05:47 -07:00
40e5ef08fd mapping: allow lists to be mapped (#149) 2023-03-28 21:55:21 -07:00
5529d4993b makefile: fix typo (#147) 2023-03-14 19:53:48 -07:00
d72f05bb0b docker: fix build and push of manifest (#145) 2023-03-14 19:42:14 -07:00
d53e5f9b5a compose: update Clickhouse schema to match casing of proto (#133)
This commit resolves an issue with the mapping between the ClickHouse
schema and the flow.proto schema.

In 3326554, the casing of the proto fields was updated, but the
ClickHouse column names were not also updated, resulting in the
ClickHouse Kafka engine only being able to successfully deserialize
fields that without an underscore.

Also updates the provisioned dashboards. Versions of the tools are also updated.

Co-authored-by: lspgn <lspgn@users.noreply.github.com>
2023-03-06 20:39:33 -08:00
176eb8772f docs: fix SrcVlan/VlanId mapping between protocols (#136)
In source code:

```go
	NFV9_FIELD_SRC_VLAN                     = 58
	NFV9_FIELD_DST_VLAN                     = 59

	IPFIX_FIELD_vlanId                                = 58
	IPFIX_FIELD_postVlanId                            = 59

		case netflow.NFV9_FIELD_SRC_VLAN:
			DecodeUNumber(v, &(flowMessage.VlanId))
			DecodeUNumber(v, &(flowMessage.SrcVlan))
		case netflow.NFV9_FIELD_DST_VLAN:
			DecodeUNumber(v, &(flowMessage.DstVlan))
```
2023-03-06 19:09:47 -08:00
332655476b proto: change protobuf definition case (#109) 2022-10-08 15:47:31 -07:00
f542b64401 clear logging statement (#129) 2022-10-08 15:36:20 -07:00
f6a776993f format: improve text formatter (#110) 2022-10-08 15:29:06 -07:00
e3471e58c6 fix single ip template case (#106) 2022-10-08 15:16:40 -07:00