GRASS logo

NAME

r.object.activelearning - Active learning for classifying raster objects

KEYWORDS

SYNOPSIS

r.object.activelearning
r.object.activelearning --help
r.object.activelearning training_set=name test_set=name unlabeled_set=name [learning_steps=integer] [nbr_uncertainty=integer] [diversity_lambda=float] [c_svm=float] [gamma_parameter=float] [search_iter=integer] [update=name] [predictions=name] [training_updated=name] [unlabeled_updated=name] [--overwrite] [--help] [--verbose] [--quiet] [--ui]

Flags:

--overwrite
Allow output files to overwrite existing files
--help
Print usage summary
--verbose
Verbose module output
--quiet
Quiet module output
--ui
Force launching GUI dialog

Parameters:

training_set=name [required]
Training set (csv format)
test_set=name [required]
Test set (csv format)
unlabeled_set=name [required]
Unlabeled samples (csv format)
learning_steps=integer
Number of samples to label at each iteration
Default: 5
nbr_uncertainty=integer
Number of samples to select (based on uncertainty criterion) before applying the diversity criterion.
Default: 15
diversity_lambda=float
Lambda parameter used in the diversity heuristic
Default: 0.25
c_svm=float
Penalty parameter C of the error term
gamma_parameter=float
Kernel coefficient
search_iter=integer
Number of parameter settings that are sampled in the automatic parameter search (C, gamma).
Default: 15
update=name
Training set update file
predictions=name
Output file for class predictions
training_updated=name
Output file for the updated training file
unlabeled_updated=name
Output file for the updated unlabeled file

Table of contents

DESCRIPTION

This module uses SVM from the scikit-learn python package to perform classification on regions of raster maps. These regions can be the output of i.segment or r.clump.

The module enables learning with only a small initial labeled data set via active learning. This semi-supervised learning algorithm interactively query the user to label the regions that are most useful to improve the overall classification score. With this technique, the number of examples to learn the classification is often much lower than the number of examples needed in normal supervised algorithms. You should start the classification with a small training set and run the module multiple times to label new informative samples to improve the classification score. The score metric is the number of correctly predicted labels over the total number of samples in the test set.

The samples that are chosen to be labeled are the ones where the class prediction is the most uncertain [2]. Moreover, from the more uncertain samples, only the most different samples are kept [1]. This diversity heuristic takes into account for each uncertain sample the distance to its closest neighbour and the average distance to all other samples. This ensures that newly labeled samples are not redundant with each other.

The learning data should be composed of features extracted from the regions, for example with the i.segment.stats module. The features of the training set, the test set and the unlabeled set should be in three different files in csv format. The first line of each file must be a header containing the features' name. Every regions should be uniquely identified by the first attribute. The classes for the training and test examples should be the second attribute.

Example of a training and test files :

			cat,Class_num,attr1,attr2,attr3
			167485,4,3.546,456.76,6.76
			183234,6,5.76,1285.54,9.45
			173457,2,5.65,468.76,6.78
		

Example of an unlabeled file :

			cat,attr1,attr2,attr3
			167485,3.546,456.76,6.76
			183234,5.76,1285.54,9.45
			173457,5.65,468.76,6.78
		

The training set can be easily updated once you have labeled new samples. Create a file to specify what label you give to which sample. This file in csv format should have a header and two attributes per line : the ID of the sample you have labeled and the label itself. The module will transfer the newly labeled samples from the unlabeled set to the training set, adding the class you have provided. This is done internally and does not modify your original files.

If the user wants to save the changes in new files according to the updates, new files can be created with the new labeled samples added to the training file and removed from the unlabeled file. Just specify the path of those output files in the parameters (training_updated, unlabeled_updated).

Example of an update file :

			cat,Class_num
			194762,2
			153659,6
			178350,2
		

Here are more details on a few parameters :

EXAMPLES

The following examples are based on the data files found in this module repository.

Simple run without an update file

		r.object.activelearning training_set=/path/to/training_set.csv \
					test_set=/path/to/test_set.csv \
					unlabeled_set=/path/to/unlabeled_set.csv

		Parameters used : C=146.398423284, gamma=0.0645567086567, lambda=0.25
		12527959
		9892568
		13731120
		15445003
		13767630
		Class predictions written to predictions.csv
		Training set : 70
		Test set : 585
		Unlabeled set : 792
		Score : 0.321367521368
	

With an update file

The five samples output at the previous example have been labeled and added to the update file.
		r.object.activelearning training_set=/path/to/training_set.csv \
		                        test_set=/path/to/test_set.csv \
					unlabeled_set=/path/to/unlabeled_set.csv \
					update=/path/to/update.csv

		Parameters used : C=101.580687073, gamma=0.00075388337475, lambda=0.25
		Class predictions written to predictions.csv
		Training set : 75
		Test set : 585
		Unlabeled set : 787
		Score : 0.454700854701
		8691475
		9321017
		14254774
		14954255
		15838185
	

NOTES

This module requires the scikit-learn python package. This module needs to be installed in your GRASS GIS Python environment. Please refer to r.learn.ml's notes on how to install this package.

The memory usage for ~1450 samples of 52 features each is around ~650 kb. This number can vary due to the unpredictablity of the garbage collector's behaviour. Everything is computed in memory; therefore the size of the data is limited by the amount of RAM available.

REFERENCES

[1] Bruzzone, L. and Persello, C. (2009). Active learning for classification of remote sensing images. 2009 IEEE International Geoscience and Remote Sensing Symposium. doi:10.1109/igarss.2009.5417857
[2] Tuia, D. et al (2011). A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification. IEEE Journal of Selected Topics in Signal Processing, 5(3), 606-617. doi:10.1109/jstsp.2011.2139193

AUTHOR

Lucas Lefèvre (ULB, Brussels, Belgium)

SOURCE CODE

Available at: r.object.activelearning source code (history)

Latest change: Monday Jan 30 19:52:26 2023 in commit: cac8d9d848299297977d1315b7e90cc3f7698730


Main index | Raster index | Topics index | Keywords index | Graphical index | Full index

© 2003-2023 GRASS Development Team, GRASS GIS 8.2.2dev Reference Manual