Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev #20

Merged
merged 36 commits into from
Jun 19, 2024
Merged

Dev #20

Changes from 1 commit
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
f60ffa9
solve minor issues
edadaltocg Jun 1, 2023
99a0332
implement Beyond AUROC \& Co.
edadaltocg Jun 7, 2023
9e8c52d
small changes
edadaltocg Jul 3, 2023
628de5c
improve aggregations
edadaltocg Jul 3, 2023
9626764
fix typo
edadaltocg Jul 3, 2023
3acf527
ninco ssb clean benchmark
edadaltocg Aug 21, 2023
14c7541
update imagenet benchmarks
edadaltocg Aug 21, 2023
8e83cdb
small changes
edadaltocg Aug 23, 2023
3888942
p-value combining method
edadaltocg Sep 13, 2023
40bda81
small changes
edadaltocg Sep 13, 2023
89928e7
update doi
edadaltocg Sep 25, 2023
14aa3b2
update some datasets to hf hub
edadaltocg Oct 31, 2023
8e8a773
crop_pct bug
edadaltocg Nov 2, 2023
f147ea8
Ensembling + SC
edadaltocg Dec 14, 2023
40ec8d6
fix pipelines
edadaltocg Dec 14, 2023
4887663
docs
edadaltocg Jan 2, 2024
260596e
fix docstrings
edadaltocg Jan 2, 2024
802ec63
remove requirements.txt
edadaltocg Jan 2, 2024
251ed22
remove ba
edadaltocg Jan 2, 2024
db10b31
remove ba
edadaltocg Jan 2, 2024
fe9ea60
bump version
edadaltocg Jan 2, 2024
0bb1123
remove reqs
edadaltocg Jan 2, 2024
c1c04a3
bump actions
edadaltocg Jan 2, 2024
79ee723
minor fix
edadaltocg Jan 2, 2024
00c0dc1
minor fix
edadaltocg Jan 2, 2024
17beb4a
update pypi workflow
edadaltocg Jan 2, 2024
30b9861
fix typo
edadaltocg Jan 2, 2024
e7a67c3
download imagenet models
edadaltocg Jan 15, 2024
64c0e7b
Improvements to pipelines
edadaltocg Jun 19, 2024
e815c58
Code + docs cleaning
edadaltocg Jun 19, 2024
20ffb04
Combine and conquer score aggregation
edadaltocg Jun 19, 2024
eb9a811
helpful scripts
edadaltocg Jun 19, 2024
dac1ec3
Merge branch 'master' of https://github.com/edadaltocg/detectors into…
edadaltocg Jun 19, 2024
362f697
remove requirements.txt
edadaltocg Jun 19, 2024
46bba8a
Format
edadaltocg Jun 19, 2024
f6229f1
Simplify tests
edadaltocg Jun 19, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs
edadaltocg committed Jan 2, 2024
commit 4887663d8ee7d524b54dc24de35f073dcfc06de6
16 changes: 16 additions & 0 deletions docs/source/detectors.aggregations.rst
Original file line number Diff line number Diff line change
@@ -20,6 +20,14 @@ detectors.aggregations.basics module
:undoc-members:
:show-inheritance:

detectors.aggregations.blahut\_arimoto module
---------------------------------------------

.. automodule:: detectors.aggregations.blahut_arimoto
:members:
:undoc-members:
:show-inheritance:

detectors.aggregations.cosine module
------------------------------------

@@ -44,6 +52,14 @@ detectors.aggregations.mahalanobis module
:undoc-members:
:show-inheritance:

detectors.aggregations.power module
-----------------------------------

.. automodule:: detectors.aggregations.power
:members:
:undoc-members:
:show-inheritance:

detectors.aggregations.quantile module
--------------------------------------

24 changes: 24 additions & 0 deletions docs/source/detectors.data.rst
Original file line number Diff line number Diff line change
@@ -4,6 +4,14 @@ detectors.data package
Submodules
----------

detectors.data.300k\_random\_images module
------------------------------------------

.. automodule:: detectors.data.300k_random_images
:members:
:undoc-members:
:show-inheritance:

detectors.data.cifar\_wrapper module
------------------------------------

@@ -100,6 +108,14 @@ detectors.data.mos module
:undoc-members:
:show-inheritance:

detectors.data.ninco\_ssb\_clean module
---------------------------------------

.. automodule:: detectors.data.ninco_ssb_clean
:members:
:undoc-members:
:show-inheritance:

detectors.data.noise module
---------------------------

@@ -148,6 +164,14 @@ detectors.data.tiny\_imagenet\_r\_c module
:undoc-members:
:show-inheritance:

detectors.data.utils module
---------------------------

.. automodule:: detectors.data.utils
:members:
:undoc-members:
:show-inheritance:

detectors.data.wilds\_ds module
-------------------------------

88 changes: 88 additions & 0 deletions docs/source/detectors.methods.rst
Original file line number Diff line number Diff line change
@@ -12,6 +12,22 @@ detectors.methods.ae module
:undoc-members:
:show-inheritance:

detectors.methods.argmax module
-------------------------------

.. automodule:: detectors.methods.argmax
:members:
:undoc-members:
:show-inheritance:

detectors.methods.ash module
----------------------------

.. automodule:: detectors.methods.ash
:members:
:undoc-members:
:show-inheritance:

detectors.methods.bats module
-----------------------------

@@ -100,6 +116,14 @@ detectors.methods.gram module
:undoc-members:
:show-inheritance:

detectors.methods.igeood\_features module
-----------------------------------------

.. automodule:: detectors.methods.igeood_features
:members:
:undoc-members:
:show-inheritance:

detectors.methods.igeood\_logits module
---------------------------------------

@@ -116,6 +140,14 @@ detectors.methods.kl\_matching module
:undoc-members:
:show-inheritance:

detectors.methods.knn\_cosine module
------------------------------------

.. automodule:: detectors.methods.knn_cosine
:members:
:undoc-members:
:show-inheritance:

detectors.methods.knn\_euclides module
--------------------------------------

@@ -124,6 +156,22 @@ detectors.methods.knn\_euclides module
:undoc-members:
:show-inheritance:

detectors.methods.knn\_projection module
----------------------------------------

.. automodule:: detectors.methods.knn_projection
:members:
:undoc-members:
:show-inheritance:

detectors.methods.l1norm module
-------------------------------

.. automodule:: detectors.methods.l1norm
:members:
:undoc-members:
:show-inheritance:

detectors.methods.logit\_norm module
------------------------------------

@@ -140,6 +188,14 @@ detectors.methods.mahalanobis module
:undoc-members:
:show-inheritance:

detectors.methods.masf module
-----------------------------

.. automodule:: detectors.methods.masf
:members:
:undoc-members:
:show-inheritance:

detectors.methods.max\_logits module
------------------------------------

@@ -204,6 +260,22 @@ detectors.methods.openmax module
:undoc-members:
:show-inheritance:

detectors.methods.plugin\_bb module
-----------------------------------

.. automodule:: detectors.methods.plugin_bb
:members:
:undoc-members:
:show-inheritance:

detectors.methods.pnml module
-----------------------------

.. automodule:: detectors.methods.pnml
:members:
:undoc-members:
:show-inheritance:

detectors.methods.projection module
-----------------------------------

@@ -244,6 +316,22 @@ detectors.methods.relative\_mahalanobis module
:undoc-members:
:show-inheritance:

detectors.methods.residual module
---------------------------------

.. automodule:: detectors.methods.residual
:members:
:undoc-members:
:show-inheritance:

detectors.methods.she module
----------------------------

.. automodule:: detectors.methods.she
:members:
:undoc-members:
:show-inheritance:

detectors.methods.ssd module
----------------------------

8 changes: 8 additions & 0 deletions docs/source/detectors.models.rst
Original file line number Diff line number Diff line change
@@ -12,6 +12,14 @@ detectors.models.densenet module
:undoc-members:
:show-inheritance:

detectors.models.dino module
----------------------------

.. automodule:: detectors.models.dino
:members:
:undoc-members:
:show-inheritance:

detectors.models.resnet module
------------------------------

30 changes: 27 additions & 3 deletions docs/source/detectors.pipelines.rst
Original file line number Diff line number Diff line change
@@ -20,6 +20,22 @@ detectors.pipelines.covariate\_drift module
:undoc-members:
:show-inheritance:

detectors.pipelines.drift module
--------------------------------

.. automodule:: detectors.pipelines.drift
:members:
:undoc-members:
:show-inheritance:

detectors.pipelines.misclassif module
-------------------------------------

.. automodule:: detectors.pipelines.misclassif
:members:
:undoc-members:
:show-inheritance:

detectors.pipelines.ood module
------------------------------

@@ -36,10 +52,18 @@ detectors.pipelines.osr module
:undoc-members:
:show-inheritance:

detectors.pipelines.ttoodda module
----------------------------------
detectors.pipelines.sc module
-----------------------------

.. automodule:: detectors.pipelines.sc
:members:
:undoc-members:
:show-inheritance:

detectors.pipelines.scod module
-------------------------------

.. automodule:: detectors.pipelines.ttoodda
.. automodule:: detectors.pipelines.scod
:members:
:undoc-members:
:show-inheritance:
21 changes: 21 additions & 0 deletions docs/source/detectors.preprocessing.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
detectors.preprocessing package
===============================

Submodules
----------

detectors.preprocessing.basics module
-------------------------------------

.. automodule:: detectors.preprocessing.basics
:members:
:undoc-members:
:show-inheritance:

Module contents
---------------

.. automodule:: detectors.preprocessing
:members:
:undoc-members:
:show-inheritance:
17 changes: 17 additions & 0 deletions docs/source/detectors.rst
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ Subpackages
detectors.methods
detectors.models
detectors.pipelines
detectors.preprocessing

Submodules
----------
@@ -32,6 +33,14 @@ detectors.criterions module
:undoc-members:
:show-inheritance:

detectors.ensemble module
-------------------------

.. automodule:: detectors.ensemble
:members:
:undoc-members:
:show-inheritance:

detectors.eval module
---------------------

@@ -40,6 +49,14 @@ detectors.eval module
:undoc-members:
:show-inheritance:

detectors.scod\_eval module
---------------------------

.. automodule:: detectors.scod_eval
:members:
:undoc-members:
:show-inheritance:

detectors.trainer module
------------------------

10 changes: 6 additions & 4 deletions examples/ensemble_drift.py
Original file line number Diff line number Diff line change
@@ -1,13 +1,15 @@
import os
import json
import logging
import os

import numpy as np
import pandas as pd
from tqdm import tqdm

import detectors
from detectors.ensemble import fisher_tau_method, p_value_fn, get_combine_p_values_fn, ensemble_names
import logging
from drift_cpu import main as drift_cpu_main
from detectors.config import RESULTS_DIR
from detectors.ensemble import ensemble_names, fisher_tau_method, get_combine_p_values_fn, p_value_fn
from drift_cpu import main as drift_cpu_main

_logger = logging.getLogger(__name__)

2 changes: 1 addition & 1 deletion examples/ood_benchmark.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
import sys
import argparse
import json
import logging
import os
import sys

import timm
import timm.data
8 changes: 4 additions & 4 deletions scripts/parse_arxiv.py
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
"""Requirements
- feedparser installed: pip install feedparser
"""
import os
import argparse
import urllib
import urllib.request
import feedparser
import json
import logging
import os
import urllib
import urllib.request

import feedparser

logging.basicConfig(
format="%(asctime)s:%(levelname)s:%(filename)s:%(lineno)s-%(funcName)s: %(message)s",
5 changes: 3 additions & 2 deletions scripts/push_dataset_to_hf_hub.py
Original file line number Diff line number Diff line change
@@ -9,12 +9,13 @@
import argparse
import os

from huggingface_hub.hf_api import create_repo
from huggingface_hub.repocard import DatasetCard, DatasetCardData

import datasets
import detectors
import parse_arxiv
from datasets import Dataset
from huggingface_hub.hf_api import create_repo
from huggingface_hub.repocard import DatasetCard, DatasetCardData


def main(
Loading