Skip to content

Commit

Permalink
Do not error out when grep does not find anything. (#1545)
Browse files Browse the repository at this point in the history
  • Loading branch information
dkinzer authored Dec 17, 2024
1 parent bc85510 commit 0126649
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions funcake_dags/scripts/transform.sh
Original file line number Diff line number Diff line change
Expand Up @@ -47,12 +47,12 @@ do
echo "</collection>" >> $SOURCE_XML-2.xml

java -jar $SAXON_CP -xsl:$SCRIPTS_PATH/batch-transform.xsl -s:$SOURCE_XML-2.xml -o:$SOURCE_XML-transformed.xml -t
COUNT=$(cat $SOURCE_XML-transformed.xml | grep -o "<oai_dc:dc" | wc -l)
COUNT=$(cat $SOURCE_XML-transformed.xml | grep -o "<oai_dc:dc" | wc -l || echo 0)
TOTAL_TRANSFORMED=$(expr $TOTAL_TRANSFORMED + $COUNT)
aws s3 cp $SOURCE_XML-transformed.xml s3://$BUCKET/$TRANSFORM_XML

TEMPFILE=$(mktemp /tmp/identifier-output-$DAG_ID.XXXXXX)
cat $SOURCE_XML-transformed.xml | grep "^<dcterms:identifier>\|</dcterms:identifier>$" >> $TEMPFILE
cat $SOURCE_XML-transformed.xml | grep "^<dcterms:identifier>\|</dcterms:identifier>$" >> $TEMPFILE || true
done

IDENTIFIER_FILE=$(mktemp /tmp/all-identifiers-$DAG_ID.XXXXXX)
Expand Down

0 comments on commit 0126649

Please sign in to comment.