Content Description of One-minute Segments of Audio #252

towsey · 2019-08-22T07:16:13Z

Is your feature request related to a problem?

Content Description is intended to be a new functionality. It's purpose is to describe the ecologically relevant content in one minute segments of audio.

Describe the solution you'd like

Intention is to create a new folder within the AudioAnalysisTools project.
In the first instance, it will contain classes to obtain content description using five previously calculated acoustic indices as a feature description of the minute.

Describe alternatives you've considered

Did consider deriving the content description at one hour resolution using features extracted from the ribbon plots already calculated.

Additional context

In the first instance the intention is to write code to obtain proof of concept.

atruskie · 2019-08-22T07:23:40Z

Sounds like a great idea 👍

As we discussed offline:

I recommend a cleanroom implementation with unit tests for the file in AudioAnalysisTools
- Use tests, avoid sandpit
- do not pass in any files, paths, config files, or CSV files (you may pass the strongly typed/deserialized versions of these)
- I'd expect to see roughly
  - one method for getting a signature for a minute
  - one method for getting an aggregate signature for a collection of minute signatures
I'd like to see a strongly type Signature class
As we move to developing this properly, it should have its own IAnalyzer2

More notes to come

Issue #252. Set up the folder and the central class to prepare feature vectors from which content content description will be derived.

Issue #252 Start work on reading index matrices and checking that they are correctly read by producing a grey-scale spectrogram.

…sses Issue #252 Set up methods for producing images that can easily validate the output from content description classes. Use random number generator to quick start. Write code to attach score/description track to an LDFC spectrogram.

Issue #252 Set up WindContent class to determine content of different kinds of wind sound. Set up a loop to cycle through the minutes of acoustic spectral indices.

Issue #252 Writing methods to calculate and display acoustic content.

Issue #252 Set up basic approach to scoring broad band events such as wind and rain.

Issue #252 Set up separate class for determining amount of each type of acoustic content. Add new class to hold visualization methods. Having difficulty with writing strings to image so play around with ImageTrack.cs but cannot fix problem. Set up BaseContent.cs class with eventual intention to do inheritance.

Issue #252 Set up two new conetent type classes and refactor other classes

Issue #252 Add Manahattan disctance as option but does not appear to differ from the Euclidean. To some resharper inspired things.

Issue #252 Add visualisation methods to Plot class to fix up the text drawing problems described in previous commit.

Issue #252 Set up new data structures for content description based on discussion with Anthony. Separate out main template information into yaml files.

Issue #252 Finalise three content algoithms. Newly factored code to read in templates from yaml file is now working for three content sesarch algorithms and five content types.

Issue #252 remove old base type and set up new template creation algorithms

Issue #252 Start work on code to do editing Template manifests. Arrange to write backup Mainfest file when editing the original.

Issue #252 Done most of the work now that Anthony and I talked about last week to refactor the code for content description.

Issue #252 Refactor code. Work with template arrays as opposed to dictionary. Gradually working towards having separate Manifest and TemplateDescription files.

Issue #252 Set up reading and writing of Json template files

…nitions. Issue #252 Complete refactoring of code to separate manifests from template definitions. Also add method to ivuslise score distributions.

Issue #252 - z-score normalisation works best even though the scores are not normally distributed.

Issue #252

Issue #252 Testing that manifest to tesmplates works with various combinations of edit status.

Issue #252

Issue #252 Set up class to calculate on spectral indices ACI, ENT, EVN, BGN, PMN and OSC.

Issue #252 More work on content description via IAnalyzer2

Issue #252 Set up IAnalyzer2 system ready for Content description

Issue #252 Content description now working through IAnalyzer2 architecture. But much cleaning up work needs to be done.

Issue #252 Continue integrating COntent Descirption into IAnalyzer2. Change name of one of the ContentDescription.cs classes to remove confusion. Some resharper stuff.

Issue #252 Finally get content description working in IAnalyzer2 environment.

Issue #252 Pretty much the last things to do with Content Description. Unit tests remain to be done.

Issue #252 Pass more settings in config file to subsequent analysis.

Issue #252 Delete five classes that were originally used to define different templates but hwich are now described in the yml and jason templates files. Other changes are small changes required to run software on different computer.

Issue #252 Change structure of data in the json file with the intention of changing the Template Manifest file to match.

Issue #252 Shift the calculation of content description from method SummarizeResults() to the actual Analysis loop. This is possible because the content description for each minute is independent of other minutes.

Issue #252 Create a new SpectralIndexValues class just for Content description so that we can use a results class that fits the purpose, i.e. just six spectral indices.

Issue #252 Rework methods in ContentSignatures.cs inorder to be consistent with methods in ContentDescription.cs.

Issue #252 Implement entry point (as started by Anthony) for building content description models. Change name of ContentDescription.cs file to UseModel.cs. Need to adjust methods to deal with new manifests data structure.

Issue #252 Add testing capcability to the Build/Make templates. Testing requires two additional arguments to BuildModel.Execute but the arguments and the testing are optional. Testing not done if two additional arguments are not provided.

Issue #252 Deleted content of Sandpit.cs Anthony can relax after so many years!

Issue #252. Change output file name.

Issue #252. Work done by Anthony to implement a new Results class for returning the six spectral indices used for content description.

Issue #252 Fail to fix bug in UseModel.cs.

towsey added a commit that referenced this issue Aug 27, 2019

Set up ConentDescription project

857b9f7

Issue #252. Set up the folder and the central class to prepare feature vectors from which content content description will be derived.

towsey added a commit that referenced this issue Sep 4, 2019

Write methods to read in acoustic index spectrograms.

d1d9f9f

Issue #252 Start work on reading index matrices and checking that they are correctly read by producing a grey-scale spectrogram.

towsey added a commit that referenced this issue Sep 6, 2019

Continue setting up Content description framework.

4847c10

Issue #252 Set up WindContent class to determine content of different kinds of wind sound. Set up a loop to cycle through the minutes of acoustic spectral indices.

towsey added a commit that referenced this issue Sep 7, 2019

Building more of code structure for content descirption

d2511f4

Issue #252 Writing methods to calculate and display acoustic content.

towsey added a commit that referenced this issue Sep 9, 2019

Set up wind and rain detection methods

c2ec082

Issue #252 Set up basic approach to scoring broad band events such as wind and rain.

towsey added a commit that referenced this issue Sep 13, 2019

Set up two new content types, Morning Chorus and Silver Eye

45aeb8b

Issue #252 Set up two new conetent type classes and refactor other classes

towsey added a commit that referenced this issue Sep 15, 2019

Add another way of calculating distance

7747fd5

Issue #252 Add Manahattan disctance as option but does not appear to differ from the Euclidean. To some resharper inspired things.

towsey added a commit that referenced this issue Sep 16, 2019

Added visualisation methods to Plot.cs

6a319be

Issue #252 Add visualisation methods to Plot class to fix up the text drawing problems described in previous commit.

towsey added a commit that referenced this issue Sep 19, 2019

Issue #252 Set up new data structures for content description

0132e83

Issue #252 Set up new data structures for content description based on discussion with Anthony. Separate out main template information into yaml files.

towsey added a commit that referenced this issue Sep 19, 2019

Issue #252 Finalise three content algoithms

1ac77f0

Issue #252 Finalise three content algoithms. Newly factored code to read in templates from yaml file is now working for three content sesarch algorithms and five content types.

towsey added a commit that referenced this issue Sep 21, 2019

Start work on Template Creation

1b8e776

Issue #252 remove old base type and set up new template creation algorithms

towsey added a commit that referenced this issue Sep 22, 2019

Issue #252 Start work on template editing

418032d

Issue #252 Start work on code to do editing Template manifests. Arrange to write backup Mainfest file when editing the original.

towsey added a commit that referenced this issue Sep 23, 2019

Work on template creation

cb7f80a

Issue #252 Done most of the work now that Anthony and I talked about last week to refactor the code for content description.

towsey added a commit that referenced this issue Oct 1, 2019

Issue #252 Refactor code as per Anthony suggestions

6bd20d2

Issue #252 Refactor code. Work with template arrays as opposed to dictionary. Gradually working towards having separate Manifest and TemplateDescription files.

towsey added a commit that referenced this issue Oct 2, 2019

Set up Json reading and writing of template files

d683f11

Issue #252 Set up reading and writing of Json template files

towsey added a commit that referenced this issue Oct 4, 2019

Complete refactoring of code to separate manifests from template defi…

7f1c504

…nitions. Issue #252 Complete refactoring of code to separate manifests from template definitions. Also add method to ivuslise score distributions.

towsey added a commit that referenced this issue Oct 5, 2019

Experiment with different score normalisations

d471feb

Issue #252 - z-score normalisation works best even though the scores are not normally distributed.

towsey added a commit that referenced this issue Oct 6, 2019

Improve score normalisation

a1fbbc9

Issue #252

towsey added a commit that referenced this issue Oct 7, 2019

Testing that manifest to tesmplates works

17a56e3

Issue #252 Testing that manifest to tesmplates works with various combinations of edit status.

towsey added a commit that referenced this issue Oct 8, 2019

Set up Content Description as IAnalyzer2.

42b429a

Issue #252

towsey added a commit that referenced this issue Oct 9, 2019

Set up class to calculate only six spectral indices

e7a4052

Issue #252 Set up class to calculate on spectral indices ACI, ENT, EVN, BGN, PMN and OSC.

towsey added a commit that referenced this issue Oct 17, 2019

More work on content description

d765d94

Issue #252 More work on content description via IAnalyzer2

towsey added a commit that referenced this issue Oct 18, 2019

Set up IAnalyzer2 system ready for Content description

b3e568e

Issue #252 Set up IAnalyzer2 system ready for Content description

towsey added a commit that referenced this issue Oct 20, 2019

Content description now works using IAnalyzer2

a52c9b0

Issue #252 Content description now working through IAnalyzer2 architecture. But much cleaning up work needs to be done.

towsey added a commit that referenced this issue Oct 21, 2019

integrating Content Descirption into IAnalyzer2.

516abf0

Issue #252 Continue integrating COntent Descirption into IAnalyzer2. Change name of one of the ContentDescription.cs classes to remove confusion. Some resharper stuff.

towsey added a commit that referenced this issue Oct 22, 2019

Finally get content description working in IAnalyzer2 environment.

9c13b79

Issue #252 Finally get content description working in IAnalyzer2 environment.

towsey added a commit that referenced this issue Oct 23, 2019

Access params from the config.yml file

b8a84bc

Issue #252 Pretty much the last things to do with Content Description. Unit tests remain to be done.

towsey added a commit that referenced this issue Oct 23, 2019

derive more params from config file

51b29d8

Issue #252 Pass more settings in config file to subsequent analysis.

towsey added a commit that referenced this issue Nov 13, 2019

Update Towsey.TemplateDefinitions.json

79f939b

Issue #252 Change structure of data in the json file with the intention of changing the Template Manifest file to match.

towsey added a commit that referenced this issue Nov 14, 2019

Create new SpectralIndexvalues class

c15800b

Issue #252 Create a new SpectralIndexValues class just for Content description so that we can use a results class that fits the purpose, i.e. just six spectral indices.

towsey added a commit that referenced this issue Nov 19, 2019

Fix up ContentSignatures.cs

129fb7f

Issue #252 Rework methods in ContentSignatures.cs inorder to be consistent with methods in ContentDescription.cs.

towsey added a commit that referenced this issue Nov 21, 2019

Update Sandpit.cs

7a0364f

Issue #252 Deleted content of Sandpit.cs Anthony can relax after so many years!

towsey added a commit that referenced this issue Nov 21, 2019

Update UseModel.cs

376a503

Issue #252. Change output file name.

towsey added a commit that referenced this issue Nov 22, 2019

Work done by Anthony to implement a new Results class for 6 indices.

9ad5c90

Issue #252. Work done by Anthony to implement a new Results class for returning the six spectral indices used for content description.

towsey added a commit that referenced this issue Dec 21, 2019

Attempt to fix bug in UseModel.cs

1e0079e

Issue #252 Fail to fix bug in UseModel.cs.

towsey mentioned this issue Jan 23, 2020

Content description (beta) #280

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Content Description of One-minute Segments of Audio #252

Content Description of One-minute Segments of Audio #252

towsey commented Aug 22, 2019

atruskie commented Aug 22, 2019

Content Description of One-minute Segments of Audio #252

Content Description of One-minute Segments of Audio #252

Comments

towsey commented Aug 22, 2019

Is your feature request related to a problem?

Describe the solution you'd like

Describe alternatives you've considered

Additional context

atruskie commented Aug 22, 2019