1
0
mirror of https://github.com/netsampler/goflow2.git synced 2024-05-06 15:54:52 +00:00

160 Commits

Author SHA1 Message Date
ff4ddca5d5 metrics: collect drops on receiver (#226) 2024-01-06 00:51:07 -08:00
9c3b0e05d6 docs: add softflowd (#272)
Co-authored-by:  René Rath <rath@oxl.at>
2024-01-06 00:36:00 -08:00
175421a5ad build(deps): bump github.com/prometheus/client_golang (#271)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.17.0 to 1.18.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.17.0...v1.18.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
v2.1.0
2024-01-01 10:27:44 +03:00
1a900554fb producer: increase performance of sampling rate lookup (#264)
Formatting a string with version and domain when looking up sampling
rate hurts performance. Instead, use a dedicated structure for key. It
also reduces the pressure on the GC.
2023-12-29 03:29:09 -08:00
e4a14c26f4 build(deps): bump google.golang.org/protobuf from 1.31.0 to 1.32.0 (#269)
Bumps google.golang.org/protobuf from 1.31.0 to 1.32.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-25 01:15:37 -08:00
3f017c46b0 bugfix: check etype size before decoding (#252) 2023-12-12 18:44:59 -08:00
1a5d58e3cf feat: handle panic (#254) 2023-12-09 11:56:30 -08:00
4f053d338f decoders: do not stop reading sets (#239) 2023-12-09 11:56:17 -08:00
1a6d8c92d1 docs: update perfs doc (#253) 2023-12-06 05:52:18 -08:00
da044ac77a producer: add datetime render (#225) 2023-12-06 05:03:45 -08:00
5ba02103eb bug: fix kafka transport default partitioning (#246) 2023-12-06 04:53:51 -08:00
3c00d97a67 docs: add performance page (#247) 2023-12-04 08:18:58 -08:00
5876530cfd compose: fix kcg dashboard query (#242) 2023-12-02 06:07:06 -08:00
a1750f5f09 decoder: ipfix have max size (#237) 2023-12-01 00:40:10 -08:00
76246841fb decoders: add test/benchmark (#232) 2023-11-04 16:04:47 -07:00
00c77d7605 decoders: improve BasicTemplateSystem (#233)
* Use write lock when removing template

Since template removal modifies the template set map, it should be done
while holding a write lock, instead of a read lock.

* Optimize BasicTemplateSystem

The BasicTemplateSystem that comes with the library uses a 3-level map
to hold template information to avoid templateId and obsDomainId
collision between multiple protocols and hosts. However, the same can be
done by using a single map with a 64-bit key consisting of version,
templateId and obsDomainId.

This greatly simplifies the code and reduces the number of map lookups
from 3 to 1 per call to GetTemplate.

Co-authored-by: Matheus Castanho <matheus.castanho@dcc.ufmg.br>
2023-11-04 16:04:36 -07:00
a0660824f0 goflow2: add configuration example for sflow mapping (#224) 2023-10-18 19:54:47 -07:00
8428ddad91 build(deps): bump github.com/prometheus/client_golang (#219)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.16.0 to 1.17.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.16.0...v1.17.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-01 18:35:50 -07:00
2a8f999a95 decoder: fix netflow flowsets decoding (#218)
* decoder was only reading the first FlowSet of those messages, resulting in unaccounted flows

Co-authored-by: lspgn <lspgn@users.noreply.github.com>
2023-09-28 20:11:18 -07:00
34a0c1618e decoders: port reader changes from v1 to v2 (#204) 2023-09-04 03:19:41 -07:00
cfed6da9c1 producer: fix fragment for NetFlow (#215) 2023-09-01 15:22:47 -07:00
edc306cc29 goflow2: add additional parameters in listen URL (#208)
Co-authored-by: Paweł Mieczkowski <pawel.mieczkowski@redge.com>
2023-09-01 14:45:07 -07:00
9f2b0806f0 producer: fix fragment (#214) 2023-09-01 14:41:55 -07:00
bfb23ba283 producer: various improvements (#213)
* feat: add IpFlags field in the protobuf (sFlow and IPFIX populate it)
* fix: fragments parsing from previous commit
* refactor: sflow parsing functions
* feat: decode IPv6 fragment headers
* tests: add producer tests
2023-09-01 14:18:18 -07:00
085e34a85f enricher: add binary marshaller (#212) 2023-08-31 23:27:47 -07:00
8988f2c244 producer: add missing renderer for bgp_next_hop (#210) 2023-08-31 22:31:34 -07:00
026fef546e fix: missing time received ns in netflow v5 (#209)
Co-authored-by: Paweł Mieczkowski <pawel.mieczkowski@redge.com>
2023-08-26 08:52:20 -07:00
a6fe3ffb12 producer: bugfix of sampling mapping for ipfix (#207) 2023-08-23 20:51:54 -07:00
4ad4f9c815 build(deps): bump github.com/libp2p/go-reuseport from 0.3.0 to 0.4.0 (#205)
Bumps [github.com/libp2p/go-reuseport](https://github.com/libp2p/go-reuseport) from 0.3.0 to 0.4.0.
- [Release notes](https://github.com/libp2p/go-reuseport/releases)
- [Commits](https://github.com/libp2p/go-reuseport/compare/v0.3.0...v0.4.0)

---
updated-dependencies:
- dependency-name: github.com/libp2p/go-reuseport
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-21 08:34:25 -07:00
b047aafe15 goflow2: allows using a single port for multiple protocols (sFlow, NetFlow, IPFIX) (#197) 2023-08-14 18:39:56 -07:00
a248b2d458 build: add release container registry workflow (#201) 2023-08-09 22:58:57 -07:00
38290af6af build: add container registry workflow (#200) 2023-08-09 22:47:01 -07:00
6b6d464b38 build: update to go v1.21 (#198) v2.0.0 2023-08-09 20:33:17 -07:00
e8cca7d3fb build(deps): bump github.com/prometheus/client_golang (#193)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.0 to 1.16.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.0...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 20:02:42 -07:00
8fc051af8f build(deps): bump github.com/oschwald/geoip2-golang from 1.8.0 to 1.9.0 (#194)
Bumps [github.com/oschwald/geoip2-golang](https://github.com/oschwald/geoip2-golang) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/oschwald/geoip2-golang/releases)
- [Commits](https://github.com/oschwald/geoip2-golang/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/oschwald/geoip2-golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 20:00:35 -07:00
458e90777f producer: fix fragments (#196) 2023-08-09 19:57:45 -07:00
a705ba8705 build(deps): bump github.com/libp2p/go-reuseport from 0.2.0 to 0.3.0 (#192)
Bumps [github.com/libp2p/go-reuseport](https://github.com/libp2p/go-reuseport) from 0.2.0 to 0.3.0.
- [Release notes](https://github.com/libp2p/go-reuseport/releases)
- [Commits](https://github.com/libp2p/go-reuseport/compare/v0.2.0...v0.3.0)

---
updated-dependencies:
- dependency-name: github.com/libp2p/go-reuseport
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:50 -07:00
2384ca9feb build(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#191)
Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:42 -07:00
9cd0bd38bd build(deps): bump github.com/sirupsen/logrus from 1.9.0 to 1.9.3 (#195)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.0 to 1.9.3.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.0...v1.9.3)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 19:51:22 -07:00
ae56e41786 refactor: v2 (#150) 2023-08-09 19:47:20 -07:00
1298b9408d Update issue templates (#189) 2023-08-09 18:19:18 -07:00
2fe21e11f5 Update issue templates (#188) 2023-08-09 18:13:55 -07:00
33c6845301 build(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#183)
Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-09 17:50:14 -07:00
3a285dce71 build(deps): bump github.com/oschwald/geoip2-golang from 1.8.0 to 1.9.0 (#181)
Bumps [github.com/oschwald/geoip2-golang](https://github.com/oschwald/geoip2-golang) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/oschwald/geoip2-golang/releases)
- [Commits](https://github.com/oschwald/geoip2-golang/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: github.com/oschwald/geoip2-golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-22 23:52:06 -07:00
2523abfc9f build(deps): bump github.com/prometheus/client_golang (#180)
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-22 23:41:12 -07:00
e5461ee848 build(deps): bump github.com/sirupsen/logrus from 1.9.2 to 1.9.3 (#176)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.2 to 1.9.3.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.2...v1.9.3)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-04 19:25:07 -07:00
dc8d7c5739 build(deps): bump github.com/stretchr/testify from 1.8.3 to 1.8.4 (#177)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.3 to 1.8.4.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.3...v1.8.4)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-04 19:12:49 -07:00
e5696f114b decoders: fix netflow legacy/v5 sampling interval (#171) v1.3.4 2023-05-25 06:10:28 -07:00
e657df6080 build(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3 (#173)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.2 to 1.8.3.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.2...v1.8.3)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Louis <lspgn@users.noreply.github.com>
2023-05-21 20:35:03 -07:00
737140c49d build(deps): bump github.com/sirupsen/logrus from 1.9.0 to 1.9.2 (#174)
Bumps [github.com/sirupsen/logrus](https://github.com/sirupsen/logrus) from 1.9.0 to 1.9.2.
- [Release notes](https://github.com/sirupsen/logrus/releases)
- [Changelog](https://github.com/sirupsen/logrus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sirupsen/logrus/compare/v1.9.0...v1.9.2)

---
updated-dependencies:
- dependency-name: github.com/sirupsen/logrus
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-21 19:36:28 -07:00