@sean185 Thanks for the report! Based on the traceback, the job being constructed is a "copy" job: does that seem plausible to you?

One thing you could do to help identify the problem would be to set a breakpoint at the failure, and report the contents of the resource dict. E.g.:

jobs = bqClient.list_jobs(all_users=True)
try:
    jobs = list(jobs)
except KeyError:
    import pdb; pdb.set_trace()

and then "step down" into the traceback until you get to the bottom, and pp resource.

@tseaver Thank you for responding so quickly!

Yes I think it is possible that Copy Jobs are not converted properly, since the list_jobs iterator fails when it comes listing out the copy job processed that day.

Apologies, I am not too familiar with the use of pdb, but just using your code and typing s to step through, I got the following:

-> import pdb; pdb.set_trace()
(Pdb) s
--Return--
> /home/dev-sean/BQTesting/pybq_test.py(76)<module>()->None
-> main()
(Pdb) s
Exception AttributeError: "'NoneType' object has no attribute 'path'" in <function _remove at 0x7ff60004f6e0> ignored

and so before I could type pp resource, the program has already exited.

@sean185 I'm guessing that the copy job which causes this failure was created with a single sourceTable, rather than a sequence of sourceTables (it would have been created with a different client, as we don't expose that option).

@tseaver Man, this is amazing, I think this means it'll be fixed in the next patch or something? You guys are awesome! For now though I'll have to stick with not being able to list all jobs at all =x

So when should I close this issue?

@sean185

I think this means it'll be fixed in the next patch or something? You guys are awesome! For now though I'll have to stick with not being able to list all jobs at all.

I don't think there is any way to filter / narrow the set of jobs returned by the API. You could try applying the patch from the PR to your local copy.

So when should I close this issue?

It will be closed automatically when PR #2884 gets merged.