* fixes#1260 - playwright tests
fixes#1394 - v2 search failing to find some names
fixes#1374 - Search to include new objects: Campus & Carrier
fixes#1164 - better rdap error reporting
fixes#1368 - Facility data export into Google Earth KMZ
fixes#1328 - Support web updates from a source of truth
fixes#1257 - Help text covers non-compliant email addresses
fixes#1313 - Improve email confirmation control - add 3 month option & maybe set new default value
fixes#1380 - Reset 'Social Media' to '[]' if field has no value
* linting
* remove target=_blank
* bump ES version to 8.10
* Cache and ES updates (#1459)
* elasticsearch major version pin and relock
* set decimal fields to python value on client save for load_data
* force use of redis password
* add default_meta to render
* add generated, clean up var names
* run pre-commit
* update ES for https and password
* rm cruft
* isort
---------
Co-authored-by: 20C <code@20c.com>
Co-authored-by: Matt Griswold <grizz@20c.com>
* Sorting icon from google material icons #1419
Manual IX-F import request queue can get stuck #1182
IX Object Creation Per Policy #1364
Creating a new network not possible #1401
IX-F Importer: Cosmetic issue with "resolved" emails and double-slashes in URLs after the FQDN #1334
Add a "Delete Affiliation" button/option to the profile #1226
Redis and negative caching #1431
* linting
* update gen_docs to use py3.11
* fix issue with api docs schema regen
* regen apidoc schema and db schema graph
* fix username validation for social media
* Add test case for social media validation
* linting
* tests shouldnt use redis
* also fix session cache setup (although not used atm)
* linting
* all caches to localmemcache during testing
---------
Co-authored-by: 20C <code@20c.com>
Co-authored-by: Matt Griswold <grizz@20c.com>
* fix next redirect when using U2F 2FA auth (#1191)
* Added self identifier to API
* fix migrations hierarchy after merging in previous support branch
* campus object
Co-authored-by: Stefan Pratter <stefan@20c.com>
* fix out of bound error message
add city / country to campus view
* fix tests
* relock poetry
* linting
* linting
* fix docs regen
* regen docs
* linting
* refactor self entity view to support carrier and campus object types and also make it easier to support additional object types in the future
* remove debug message
---------
Co-authored-by: Gajanan Patil <dipaksavaliya.python@gmail.com>
* Add "Last login" to https://peeringdb.com/cp/peeringdb_server/user/#879
* Bug in renumbering tool #660
* Add the IX name and id to IX-F Import Emails #963
* Use username to create deskpro person when no first-name / last-name data exists #1057
* Organization merge tool usergroup issues #930
* Exempt superusers (PeeringDB Admin Committee & Operations Committee admins) from throttling #1172
* add missing migration for #1172
* linting
* poetry relock
* adapt to django-two-factor-auth template-tag renaming changes
* increase default for DATA_QUALITY_MAX_SPEED to 5Tb
* regenerate docs
* fix api test for netixlan max speed validation
* pdb_api_cache command needs to disable CSRF_USE_SESSIONS before it runs
Co-authored-by: David Poarch <dpoarch@20c.com>
* module docstrings
* db schema graph
* dev docs first pass
* dev docs pass 2
* add generated notification to top of generated docs files
* linting
* regen docs
Co-authored-by: Stefan Pratter <stefan@20c.com>
Co-authored-by: Sunshine Buchholz <sunshine@20c.com>
* Block registering private ASN ranges
* Add a continental region field for facilities #1007
* Incorrect order of search results #232
* Allow users to upload a small logo to their record #346
* Sponsor badge CSS and text translation issues #453
* IXP and Facility summary #18
* poetry relock
* linting
* add libgcc
* lint
* bump version to 2.31.0-beta
Co-authored-by: Stefan Pratter <stefan@20c.com>
Co-authored-by: David Poarch <dpoarch@20c.com>
* django3, py39, lgtm, linting (#715)
* IX-F Importer: ticket status change when posting re-occuring conflict to existing resolved ticket (#920)
* fix recaptcha requirement for user creation in django-admin (#715)
* IX-F Importer: fix command output buffering #967
* Drop dot1q_support field #903
* fix test (#967)
* Add name, city, country to ixfac (GET operation) #166
* additional tests fir #166
* Allow IXP to trigger ix-f importer for their exchange #779
* add docker compose for dev
* add selinux labels for mountpoints
* fixes#1013: The process to permanently remove old soft-deleted network contacts pdb_delete_pocs raises a false ProtectedAction
* fix api test
* relock poetry
* remove django_namespace_perms from installed apps
* fix user permissios ui
* remove remaining references to django namespace perms
* linting
* copy tox.ini
* comment flake8 check until we figure out why it ignores configs from tox.ini
* black format
* poetry lock
Co-authored-by: Stefan Pratter <stefan@20c.com>
* stub in poetry for pipenv
* re-add tester image
* add pre-commit / formatting
* fix ghactions
* revert test data whitespace, exclude tests/data
* revert ws
* decruft, rm tox/pipenv
* install dev packages for base image
* add lgtm config to force to py3
* install django-grainy
* nsp to grainy first iteration
* Fix validation error message overflow
* Add migration, update views.py and template to add help_text to UI
* nsp to grainy second iteration
* grainy and django-grainy pinned to latest releases
* deskpro ticket cc (#875)
* black formatting
* move ac link to bottom for ticket body
* Fix typo
* Update djangorestframework, peeringdb, django-ratelimit
* Rewrite login view ratelimit decorator
* Relock pipfile
* add list() to make copy of dictionaries before iterating
* respect ix-f url visibilty in ix-f conflict emails
* Add type coercion to settings taken from environment variables
* Add bool handling
* relock pipfile with python3.9
change docker to use python3.9
* Check bool via isinstance
* add ordering to admin search queryset for deskproticket and email
* update settings with envvar_type option
* Add tooltips to add ix and add exchange views (in org)
* Add tooltip to suggest fac view
* get phone information in view
* add missing migration
* add migration and make org a geo model
* Wire normalization to put/create requests for Facility
* Update admin with new address fields
* Refactor serializer using mixin
* Add floor and suite to address API
* Write command to geonormalize existing entries
* Remove unnecessary method from model
* Add floor and suite to views
* Add ignore geo status
* Force refresh for fac and org updates
* adjust frontend typo
* add checking if update needs geosync
* redo error handling for geosync
* remove save keyword from geonormalize command script
* change raw_id_fields
* alternate autocomplete lookup field depending on where inline is called
* remove unnecessary error handling
* Add csv option
* Fix bug
with None vs empty string
* add regex parsing for suite and floor conversion
* Add migration that removes geo error as a field
* add geostatus update to command
* Ignore suite floor and address2 changes for api normalization
* update geomodel by removing geo_error
* Black models.py
* Black serializers.py
* remove geocode error from admin
* Add function for reversing pretty speed
* add conversion to export method
* fix typo
* fix speed value feedback after submit
* remove conditional
* Add error handling to create endpoint
* Refine floor and suite parsing regex
* Add geocoding tests
* Add json for tests
* IX-F Importer: Bogus output of "Preview" tool #896
* remove cruft
* black formatting
* IX-F Importer: history of changes per ixlan & netixlan #893
* 6 add geocode to org view
* 4 update geocode without refresh
* Update error display
* Fix bug with formatting translated string
* Add DateTimeFields to model
* Add update signals
* add last updated fields to views and serializers
* Add last updated model migration
* Add the data migration for last updated fields
* add test that tests a normal org user with create org permissions
* grainy to 1.7
django grainy to 1.9.1
* Fix formatting issues
* Adjust var names
* Refactor signals
* Temporary: save override from network model
* Empty vlan lists no longer cause error
* typo in ixf.py
* typo in admin
* Typos in model verbose names
* Add serializer IXLAN validation for ixf_ixp_import_enabled
* Add model validation to IXLan
* relock pipfile
* relock pipfile
* begin signal test file
* Remove full clean from save in ixlan
* use post_reversion_commit signal instead
* remove redundant save override
* remove cruft / debug code
* Add signal tests
* exclude organizations with city missing from commandline geosync
* Skip geosync if the only address information we have is a country
* initial commit for vlan matcher in importer
* Add more tests and remove unused imports
* update tests
* Actually add vlan matching to importer
* Add type checking for speed list and state
* Change how we register connection.state
* add bootstrap options
* add rdap cache command
* remove outdated perm docs
* rdap from master and relock
* propagate rdap settings to peeringdb.settings
* add loaddata for initial fixtures
* user friendly error message on RdapNotFound errors (#497)
* update rdap errors
* django-peeringdb to 2.5.0 and relock
* rdap to 1.2.0 and relock
* fix migration hierarchy
* add ignore_recurse_errors option
* add missing fields to mock
remove cruft missed during merge
* rdap to 1.2.1
* dont geo validate during api tests
* fix tests
* Add test file
* fix merge
* RDAP_SELF_BOOTSTRAP to False while running tests
* black formatted
* run black
* add github actions
* add runs on
Co-authored-by: Stefan Pratter <stefan@20c.com>
Co-authored-by: Elliot Frank <elliot@20c.com>
* Change label from primary ASN to ASN
* Raise validation error when trying to update ASN
* first steps for dotf importer procotol (#697)
* migrations (#697)
* Add translation to error meessage
* Make ASN readonly in table
* Add test now that ASN should not be able to update
* Set fac.rencode to '' for all entries and make it readonly in serializer
* Add unique constraints to network ixlan ip addresses
* Add migration to null out duplicate ipaddresses for deleted netixlans
* Add unique constraints to network ixlan ip addresses
* Add migration to null out duplicate ipaddresses for deleted netixlans
* remove old migrations (#697)
* fix netixlan ipaddr dedupe migration (#268)
add netixlan ipaddr unique constraint migration (#268)
* ixf_member_data migrations (#697)
* fix table name (#697)
* importer protocol (#697)
* fix netixlan ipaddr dedupe migration (#268)
add netixlan ipaddr unique constraint migration (#268)
* ixf proposed changes notifications (#697)
* Delete repeated query
* Add a test to show rencode is readonly
* Blank out rencode when mocking data
* Remove validator now that constraint exists
* Add back unique field validator w Check Deleted true
* conflict resolving (#697)
* UniqueFieldValidator raise error with code "unique" (#268)
* conflict resolution (#697)
* Add fixme comment to tests
* conflict resolution (#697)
* Remove now invalid undelete tests
* UniqueFieldValidator raise error with code "unique" (#268)
* delete admin tools for duplicate ip addresses
* Make migration to delete duplicateipnetworkixlan
* Add ixlan-ixpfx status matching validation, add corresponding test
* delete redundant checking in test
* resolve conflict ui (#697)
* fix migrations hierarchy
* squash migrations for ixf member data
* clean up preview and post-mortem tools
* remove non-sensical permission check when undeleting soft-deleted objects through unique integrity error handling
* only include the ix-f data url in notifications to admincom (#697)
* resolve on --skip-import (#697)
* ac conflict resolution (#697)
* Define more accurately the incompatible statuses for ixlan and ixpfx
* Add another status test
* Preventing disrupting changes (#697)
* fix tests (#697)
* Stop allow_ixp_update from being write only and add a global stat for automated networks
* Add tests for global stats that appear in footer
* Change how timezone is called with datetime, to get test_stats.py/test_generate_for_current_date to pass
* test for protected entities (#697)
* admincom conflict resolution refine readonly fields (#697)
network notifications only if the problem is actually actionable by the network (#697)
* ixp / ac notifcation when ix-f source cannot be parsed (#697)
fix issue with ixlan prefix protection (#697)
* migrations (#697)
* code documentation (#697)
* ux tweaks (#697)
* UX tweaks (#697)
* Fix typo
* fix netixlan returned in IXFMemberData.apply when adding a new one (#697)
* fix import log incosistencies (#697)
* Add IXFMemberData to test
* Update test data
* Add protocol tests
* Add tests for views
* always persist changes to remote data on set_conflict (#697)
* More tests
* always persist changes to remote data on set_conflict (#697)
* suggest-add test
* net_present_at_ix should check status (#697)
* Add more protocol tests
* Edit language of some tests
* django-peeringdb to 2.1.1
relock pipfile, pin django-ratelimit to <3 as it breaks stuff
* Add net_count_ixf field to ix object (#683)
* Add the IX-F Member Export URL to the ixlan API endpoint (#249)
* Lock some objects from being deleted by the owner (#696)
* regenerate api docs (#249)
* always persist changes to remote data on set_add and set_update (#697)
* IXFMemberData: always persist remote data changes during set_add and set_update, also allow for saving without touching the updated field
* always persist changes to remote data on set_add and set_update (#697)
* Fix suggest-add tests
* IXFMemberData: always persist remote data changes during set_add and set_update, also allow for saving without touching the updated field
* IXFMemberData: always persist remote data changes during set_add and set_update, also allow for saving without touching the updated field
* fix issue with deletion when ixfmemberdata for entry existed previously (#697)
* fix test_suggest_delete_local_ixf_no_flag (#697 tests)
* fix issue with deletion when ixfmemberdata for entry existed previously (#697)
* invalid ips get logged and notified to the ix via notify_error (#697)
* Fix more tests
* issue with previous_data when running without save (#697)
properly track speed errors (#697)
* reset errors on ixfmemberdata that go into pending_save (#697)
* add remote_data to admin view (#697)
* fix error reset inconsistency (#697)
* Refine invalid data tests
* remove debug output
* for notifications to ac include contact points for net and ix in the message (#697)
* settings to toggle ix-f tickets / emails (#697)
* allow turning off ix-f notifications for net and ix separately (#697)
* add jsonschema test
* Add idempotent tests to updater
* remove old ixf member tests
* Invalid data tests when ixp_updates are enabled
* fix speed error validation (#697)
* fix issue with rollback (#697)
* fix migration hierarchy
* fix ixfmemberdata _email
* django-peeringdb to 2.2 and relock
* add ixf rollback tests
* ixf email notifications off by default
* black formatted
* pyupgrade
Co-authored-by: egfrank <egfrank@20c.com>
Co-authored-by: Stefan Pratter <stefan@20c.com>
* increase rdap lookup timeout to 2.5
* Allow as set hierarchy according to RFC 2622 5.0 during IRR validation (#151)
* fix wording of validation error message (#151)
* allow single as in irr validation (#151)
allow as rs-set combination in irr validation (#151)
Co-authored-by: Stefan Pratter <stefan@20c.com>
* use new peeringdb client (1.0.0) for pdb_load_data sync (#599)
* drop django-mobi for lack of py3/dj2 support (#492)
remove django-forms-bootstrap for lack of py3/dj2 support (#492)
* black formatted
* django2.2 and py3 upgrade (#492)
* drop ixlans (#21) ui and api changes
* drop local_asn (#168)
* org search (#193)
* phone number validation (#50)
* implement help text tooltips (#228)
* Mark own ASN as transit-free (#394)
* py3 fix for `pdb_migrate_ixlans` command when writing migration report
* pdb_migrate_ixlans: properly handle py3 Runtime error if ixlan dict changes during iteration
* set rest DEFAULT_SCHEMA_CLASS to coreapi to fix swagger apidocs
fix migration 0027 missing from facsimile manifest
* fix swagger doc strings
* fix tests that were broken from api doc fixes
* fix UniqueFieldValidator for netixlan ipaddress validation that broke during django/drf upgrade
* fix org merge tool layout issues
* travis config
* update pipfile and lock
* black formatting
* update travis dist
* beta mode banner (#411)
* add beta banner template (#411)
* automatically scheduled sync may not always be on, add a flag that lets us reflect that state in the beta banner message
clean up beta banner implementation (#411)
* add tests for beta banner (#411)