-
Notifications
You must be signed in to change notification settings - Fork 3
Expand file tree
/
Copy pathDESCRIPTION
More file actions
69 lines (68 loc) 路 3.3 KB
/
Copy pathDESCRIPTION
File metadata and controls
69 lines (68 loc) 路 3.3 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
Package: HRTnomaly
Type: Package
Classification/MSC-2010: 62G86
Title: Historical, Relational, and Tail Anomaly-Detection Algorithms
Version: 26.9.19
Date: 2026-09-19
Authors@R: c(person(given = "Luca",
family = "Sartore",
role = "aut",
email = "luca.sartore@usda.gov",
comment = "ORCID = \"0000-0002-0446-1328\""),
person(given = "Luca",
family = "Sartore",
role = "cre",
email = "drwolf85@gmail.com",
comment = "ORCID = \"0000-0002-0446-1328\""),
person(given = "Lu",
family = "Chen",
role = "aut",
email = "lu.chen@usda.gov",
comment = "ORCID = \"0000-0003-3387-3484\""),
person(given = "Justin",
family = "van Wart",
role = "aut",
email = "justin.vanwart@usda.gov"),
person(given = "Andrew", "Dau",
role = "aut",
email = "andrew.dau@usda.gov",
comment = "ORCID = \"0009-0008-9482-5316\""),
person(given = "Valbona",
family = "Bejleri",
role = "aut",
email = "valbona.bejleri@usda.gov",
comment = "ORCID = \"0000-0001-9828-968X\""))
Maintainer: Luca Sartore <drwolf85@gmail.com>
Description: The presence of outliers in a dataset can substantially bias the
results of statistical analyses. To correct for outliers, micro edits are
manually performed on all records. A set of constraints and decision rules
is typically used to aid the editing process. However, straightforward
decision rules might overlook anomalies arising from disruption of linear
relationships. Computationally efficient methods are provided to
identify historical, tail, and relational anomalies at the data-entry
level (Sartore et al., 2024; <doi:10.6339/24-JDS1136>). A score statistic
is developed for each anomaly type, using a distribution-free approach
motivated by the Bienaym茅-Chebyshev's inequality, and fuzzy logic is used
to detect cellwise outliers resulting from different types of anomalies.
Each data entry is individually scored and individual scores are combined
into a final score to determine anomalous entries. In contrast to fuzzy
logic, Bayesian bootstrap and a Bayesian test based on empirical
likelihoods are also provided as studied by Sartore et
al. (2024; <doi:10.3390/stats7040073>). These algorithms allow for a more
nuanced approach to outlier detection, as it can identify outliers at
data-entry level which are not obviously distinct from the rest of the
data.
---
This research was supported in part by the U.S. Department of Agriculture,
National Agriculture Statistics Service. The findings and conclusions in
this publication are those of the authors and should not be construed to
represent any official USDA, or US Government determination or policy.
License: AGPL-3
Depends: R (>= 4.5.0)
Imports: dplyr, purrr, tidyr
Suggests: knitr, rmarkdown, cellWise
Encoding: UTF-8
SystemRequirements: C11 compiler
LazyLoad: yes
NeedsCompilation: yes
ByteCompile: TRUE