Metadata does not load

[stringkm]

I am running easyaccess 1.4.7 on Ubuntu 14.04, but I've had this issue in prior versions of easyaccess also. When I open easyaccess I receive the error:

$ easyaccess
Connecting to DB ** dessci ** ...
Loading metadata into cache...
There was an error when refreshing the metadata

Also, when I type "refresh_metadata_cache", I get the same error:

DESSCI ~> refresh_metadata_cache
Loading metadata into cache...
There was an error when refreshing the metadata

Without the metadata, I am unable to use basic functions such as "find_tables" which gives:

DESSCI ~> find_tables %y3a1%
| ☆ | Ctrl-C to abort;
<class 'ValueError'>
array size too large

and "describe_table" which gives:

DESSCI ~> describe_table y3a2_coadd_object_summary
Table not found.

I tried uninstalling using "conda remove easyaccess", then reinstalling using conda, but the error did not change. Is there a way to force easyaccess to download a fresh copy of the metadata or download it manually?

[mgckind]

I think this is also related to #152 , @madamow

[madamow]

@stringkm could you open easy access and run the 3 following queries? Let me know if they work, and if they not -copy/paste an error they return.

select table_name from DES_ADMIN.CACHE_TABLES union select table_name from user_tables;
select distinct username from dba_users order by username;
SELECT column_name from DES_ADMIN.CACHE_COLUMNS;

[stringkm]

Here are the results:

DESSCI ~> select table_name from DES_ADMIN.CACHE_TABLES union select table_name from user_tables;

| ☆            |  Ctrl-C to abort; 

<class 'ValueError'>
array size too large

DESSCI ~> select distinct username from dba_users order by username;

| ☆            |  Ctrl-C to abort; 

<class 'ValueError'>
array size too large

The third query was successful.

[madamow]

Please try this:

1. change name of your .desservices.ini file
2. set up a new Conda environment using python 2.7:
   conda create -n eatest python=2.7 anaconda
3. close and open your terminal
4. activate new environment
   conda activate eatest
5. install easy access with Conda using new environment (line in terminal should start with (eatest)
   conda install easyaccess==1.4.7 -c mgckind -c anaconda
6. run easy access, log in and check those three queries again and let me know if this makes any difference

[stringkm]

Unfortunately, even after reinstalling with a new environment, the results are similar, but the error codes are slightly different (maybe due to using python 2 instead of 3?).

(eatest) :~$ easyaccess

DESSCI ~> select table_name from DES_ADMIN.CACHE_TABLES union select table_name from user_tables;

<type 'exceptions.ValueError'>
array size too large

DESSCI ~> select distinct username from dba_users order by username;

<type 'exceptions.ValueError'>
array size too large

The last query was successful.

[mgckind]

Thanks @stringkm for the help in figuring this ou! t, I believe both are the same errors (which have appeared before)

[madamow]

Ok, I will try to recreate this error on Ubuntu. Thanks.

[madamow]

One more thing. Could you paste me here the result from uname -a please?

[stringkm]

Linux antec-Z87-D3HP 4.4.0-144-generic #170~14.04.1-Ubuntu SMP Mon Mar 18 15:02:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

[madamow]

I setup docker with your version of Ubuntu and easyaccess works normally.
Two more things that we can check:
content of ~/.easyaccess/config.ini
and output of conda activate eatest ; conda export env
If there will be no differences here - I am out of ideas.

[mgckind]

@stringkm, @madamow this is puzzling, as I haven't been able to reproduce the problem either :( andis related also to #152
can please you try using cx_oracle directly, to check whether the queries return successfully?
By opening python and then

import easyaccess as ea
import cx_Oracle as cx
print(cx.__version__)
con = ea.connect()
con2 = cx.connect(con.user, con.password, dsn=con.dsn)
cursor = con2.cursor()
query = 'select table_name from DES_ADMIN.CACHE_TABLES union select table_name from user_tables'
con.query_and_print(query) # this is easyaccess
cursor.execute(query).fetchall() # this is cx_Orace

[stringkm]

Sorry I took a day to do that. I had a final exam this afternoon. Here's the output from those commands. The cx_oracle command at the end was successful, but I did not include the output so I wouldn't compromise any of the private table names.