Access extra.* like normal fields

[ghost]

You can now set and get extra-fields just as all others #793 :

event['extra.foo'] = 'bla'
event['extra.foo'] # gives 'bar'

This is not limited to extra.*, it applies to anything field with type JSONDict

It now behaves correctly with the hierarchical keyword see #791

A new harminization type is introduced, the JSONDict (like the former JSON type, can only hold dicts as JSON) and JSON itself is not more relaxed (allows not only dicts, but any valid JSON). The type JSON is used for the field output.

For backwards compatibility, you can still set extra to a string holding a JSON, however I don't recommend it.

I did not yet deprecate anything (setting and getting extra as whole) because I think we need to discuss this better, also for other nested fields.

[codecov-io]

Codecov Report

Merging #1046 into develop will increase coverage by 0.14%.
The diff coverage is 88.97%.

@@             Coverage Diff             @@
##           develop    #1046      +/-   ##
===========================================
+ Coverage    75.57%   75.72%   +0.14%     
===========================================
  Files          216      217       +1     
  Lines         9196     9310     +114     
  Branches      1231     1244      +13     
===========================================
+ Hits          6950     7050     +100     
- Misses        1957     1970      +13     
- Partials       289      290       +1

Impacted Files	Coverage Δ
...s/bots/parsers/shadowserver/test_accessible_smb.py	100% <ø> (ø)	⬆️
...s/parsers/shadowserver/test_compromised_website.py	100% <ø> (ø)	⬆️
intelmq/bots/parsers/shadowserver/config.py	85.39% <ø> (ø)	⬆️
intelmq/tests/bots/outputs/mongodb/test_output.py	100% <ø> (ø)	⬆️
...elmq/tests/bots/parsers/shadowserver/test_xdmcp.py	100% <ø> (ø)	⬆️
...telmq/tests/bots/parsers/shadowserver/test_snmp.py	100% <ø> (ø)	⬆️
...sts/bots/parsers/shadowserver/test_drone_hadoop.py	100% <ø> (ø)	⬆️
...mq/tests/bots/parsers/shadowserver/test_chargen.py	100% <ø> (ø)	⬆️
...mq/tests/bots/parsers/dshield/test_parser_block.py	100% <ø> (ø)	⬆️
...q/tests/bots/parsers/anubisnetworks/test_parser.py	100% <ø> (ø)	⬆️
... and 23 more

[ghost]

Better document this: old bots can still be used, the harmonization.conf must be changed!

add a intelmqctl check for this

[ghost]

Got no feedback, so probably ok