Propagate serdeParameters to dwio writer options

Summary: serdeParameters is not properly propagated to dwio writer. Adding this plumbing to make it propagate. Differential Revision: D54027500
tanjialiang · Feb 21, 2024 · 790e098 · 790e098
1 parent 07ece26
commit 790e098
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/velox/connectors/hive/HiveDataSink.cpp b/velox/connectors/hive/HiveDataSink.cpp
@@ -675,6 +675,9 @@ uint32_t HiveDataSink::appendWriter(const HiveWriterId& id) {
       hiveConfig_->orcWriterMaxStripeSize(connectorSessionProperties));
   options.maxDictionaryMemory = std::optional(
       hiveConfig_->orcWriterMaxDictionaryMemory(connectorSessionProperties));
+  options.serdeParameters = std::map<std::string, std::string>(
+      insertTableHandle_->serdeParameters().begin(),
+      insertTableHandle_->serdeParameters().end());
   ioStats_.emplace_back(std::make_shared<io::IoStatistics>());
 
   // Prevents the memory allocation during the writer creation.