When adding a custom connector on Airbyte OSS, you may run into an error that says "Something went wrong".
Example:
- https://github.com/airbytehq/airbyte/issues/23716
To determine what's actually go wrong, you can do the following:
- Connect to the airbyte db
- Update the
actor_definition_version
table with the connector version you're having trouble with
Example:
\c airbyte; --Connect to airbyte db
-- Update to your connector version
UPDATE actor_definition_version
SET docker_image_tag = '0.2.2'
WHERE actor_definition_id = '8e410e19-e5b9-4152-a892-a78847331ee3';
- Refresh your Airbyte source connector page to see if it got updated to the
docker_image_tag
version you force. - Try to run a sync
- It should not show you the error that's causing the problem. Below is an example of the error I got:
2024-01-22 15:34:44 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - Traceback (most recent call last):
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/airbyte/integration_code/main.py", line 12, in <module>
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - source = SourceMixpanelExport()
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/airbyte/integration_code/source_mixpanel_export/source.py", line 18, in __init__
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - super().__init__(**{"path_to_yaml": "manifest.yaml"})
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/yaml_declarative_source.py", line 20, in __init__
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - source_config = self._read_and_parse_yaml_file(path_to_yaml)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/yaml_declarative_source.py", line 28, in _read_and_parse_yaml_file
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - return self._parse(decoded_yaml)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/yaml_declarative_source.py", line 42, in _parse
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - return yaml.safe_load(connection_definition_str)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/__init__.py", line 125, in safe_load
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - return load(stream, SafeLoader)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/__init__.py", line 81, in load
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - return loader.get_single_data()
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/constructor.py", line 49, in get_single_data
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - node = self.get_single_node()
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/composer.py", line 36, in get_single_node
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - document = self.compose_document()
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/composer.py", line 55, in compose_document
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - node = self.compose_node(None, None)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/composer.py", line 84, in compose_node
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - node = self.compose_mapping_node(anchor)
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/composer.py", line 127, in compose_mapping_node
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - while not self.check_event(MappingEndEvent):
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/parser.py", line 98, in check_event
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - self.current_event = self.state()
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - File "/usr/local/lib/python3.9/site-packages/yaml/parser.py", line 438, in parse_block_mapping_key
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - raise ParserError("while parsing a block mapping", self.marks[-1],
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - yaml.parser.ParserError: while parsing a block mapping
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - in "<unicode string>", line 1, column 1:
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - spec:
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - ^
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - expected <block end>, but found '<block mapping start>'
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - in "<unicode string>", line 229, column 5:
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - incremental_sync:
2024-01-22 15:34:45 [1;31mERROR[m i.a.c.i.LineGobbler(voidCall):149 - ^