Artwork by @xypnox
Various regulatory bodies publish list of people/entities who have violated laws or regulations. The primary identifier for these records are their PANs. Banks, brokers are supposed to not provide services to these entities, identified by their PANs. Unscrapulous is a python utility which has scrapers to create a huge database of such people/entities.
The PostgreSQL database unscrupulous_entities contains the following fields:
1. ID
2. PAN
3. Name
4. AddedDate (day of blacklisting according to the source)
5. Source
6. Meta (a JSON encoded field of whatever fields each source provides)
$ sudo apt-get install postgresql postgresql-contrib libpq-dev
$ pip install unscrapulous$ unscrapulous --config=config.toml$ git clone [email protected]:themousepotato/unscrapulous.git
$ cd unscrapulous
$ curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python -
$ poetry install
$ poetry build
$ pip install dist/unscrapulous-*.whlThe config.toml file has the following format:
[postgresql_conn]
host = 'localhost'
dbname = 'postgres'
user = 'postgres'
password = 'password'
[scrapers]
arbitration_awards_bse = false
arbitration_awards_nse = false
bse_defaulter_and_expelled_members = false
icex_defaulter_members = false
icex_expelled_members = false
income_tax_defaulters = false
irda_blacklisted = false
mca_company_defaulter_list = false
mca_director_defaulter_list = false
mca_director_disqualified_list = false
mca_proclaimed_offenders_ind = false
mcx_action_ap = false
mcx_defaulter_members = false
mcx_secretaries_defaulter_list = false
mse_arbitral_awards = false
ncdex_suspended_defaulted_expelled_debarred_members = false
nse_defaulted_members = false
nse_expelled_members = false
nse_regulatory_defaulting_clients = false
sebi_debarred_bse = true
sebi_debarred_nse = true
sfio_convicted = false
sfio_proclaimed_offenders = false
unsc_1988 = false
unsc_consolidated_list = false
wildlife_crime_convicts = false| Organization | Description | |
|---|---|---|
 |
Zerodha | Online platform to invest in stocks, derivatives, mutual funds, etc. |
| Source | Category | Status |
|---|---|---|
| ACE Suspended Members | A | Couldn't find source |
| Arbitration Awards - BSE | A |
|
| Arbitration Awards - NSE | A |
|
| BSE Defaulter and Expelled Members | A |
|
| BSE Regulatory Defaulting Clients | A | Couldn't find source |
| ICEX Defaulter Members | A |
|
| ICEX Expelled Members | A |
|
| MCX Action AP | A |
|
| MCX Defaulter Members | A |
|
| MSE Arbitral Awards | A |
|
| MSE Trading Clearing Members | A | Couldn't find source |
| NCDEX Suspended Defaulted Expelled Debarred Members | A |
|
| NMCE Defaulted Members | A | Couldn't find source |
| NMCE Expelled Members | A | Couldn't find source |
| NMCE Suspended Members | A | Couldn't find source |
| NSE Defaulted Members | A |
|
| NSE Expelled Members | A |
|
| NSE Regulatory Defaulting Clients | A |
|
| UAPA | A |
|
| UNSC_1267/UNSC Consolidated List | A |
|
| UNSC_1988 | A |
|
| UNSC_2140 | A | Couldn't find source |
| UNSC_2270 | A | Couldn't find source |
| SEBI Debarred - BSE | A |
|
| SEBI Debarred - NSE | A |
|
| MCA Proclaimed Offenders (Ind) | B |
|
| SFIO Convicted | B |
|
| SFIO Proclaimed Offenders | B |
|
| RBI Suit File | B |
|
| IRDA Blacklisted | B |
|
| Income Tax Defaulters | B |
|
| Wildlife Crime Convicts | B |
|
| MCA Director Defaulter List | B |
|
| MCA Director Disqualified List | B |
|
| MCX Secretaries Defaulter List | B |
|
| NCLT (IBBI) | B |
|
| MCA Company Defaulters List | B |
|
| European Union Sanctions | B | Couldn't find source |
| MCA Companies Struck Off list | B |
|
| Interpol | B | Couldn't find source |
| United Kingdom Sanction List | B |
|
| OFAC | B | Couldn't find source |
| Local PEP - Only India PEP | B | Couldn't find source |