Skip to content

tests.unit.test_reader_v1: test_to_dataframe_by_page failed #685

Closed
@flaky-bot

Description

@flaky-bot

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and
I will stop commenting.


commit: cbde9a6
buildURL: Build Status, Sponge
status: failed

Test output
class_under_test = 
mock_gapic_client = 
def test_to_dataframe_by_page(class_under_test, mock_gapic_client):
    bq_columns = [
        {"name": "int_col", "type": "int64"},
        {"name": "bool_col", "type": "bool"},
    ]
    avro_schema = _bq_to_avro_schema(bq_columns)
    block_1 = [{"int_col": 123, "bool_col": True}, {"int_col": 234, "bool_col": False}]
    block_2 = [{"int_col": 345, "bool_col": True}, {"int_col": 456, "bool_col": False}]
    block_3 = [{"int_col": 567, "bool_col": True}, {"int_col": 789, "bool_col": False}]
    block_4 = [{"int_col": 890, "bool_col": True}]
    # Break blocks into two groups to test that iteration continues across
    # reconnection.
    bq_blocks_1 = [block_1, block_2]
    bq_blocks_2 = [block_3, block_4]
    avro_blocks_1 = _bq_to_avro_blocks(bq_blocks_1, avro_schema)
    avro_blocks_2 = _bq_to_avro_blocks(bq_blocks_2, avro_schema)

    mock_gapic_client.read_rows.side_effect = (
        _pages_w_unavailable(avro_blocks_1),
        avro_blocks_2,
    )

    reader = class_under_test(
        mock_gapic_client,
        "teststream",
        0,
        {"metadata": {"test-key": "test-value"}},
    )
    got = reader.rows()
    pages = iter(got.pages)

    page_1 = next(pages)
    pandas.testing.assert_frame_equal(
      page_1.to_dataframe().reset_index(drop=True),
        pandas.DataFrame(block_1, columns=["int_col", "bool_col"]).reset_index(
            drop=True
        ),
    )

tests/unit/test_reader_v1.py:596:


google/cloud/bigquery_storage_v1/reader.py:556: in to_dataframe
return self._stream_parser.to_dataframe(self._message, dtypes=dtypes)
google/cloud/bigquery_storage_v1/reader.py:670: in to_dataframe
for row in self.to_rows(message):
google/cloud/bigquery_storage_v1/reader.py:714: in to_rows
yield fastavro.schemaless_reader(messageio, self._fastavro_schema)
fastavro/_read.pyx:1126: in fastavro._read.schemaless_reader
???
fastavro/_read.pyx:1153: in fastavro._read.schemaless_reader
???
fastavro/_read.pyx:743: in fastavro._read._read_data
???
fastavro/_read.pyx:616: in fastavro._read.read_record
???
fastavro/_read.pyx:735: in fastavro._read._read_data
???
fastavro/_read.pyx:526: in fastavro._read.read_union
???


???
E EOFError

fastavro/_read.pyx:176: EOFError

Metadata

Metadata

Assignees

No one assigned

    Labels

    api: bigquerystorageIssues related to the googleapis/python-bigquery-storage API.flakybot: issueAn issue filed by the Flaky Bot. Should not be added manually.priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions