RSS import generates duplicates

eZ Community » Forums » Developer » RSS import generates duplicates

Monday 05 October 2009 11:19:24 am - 4 replies

I'm running a site on v3.8.6. (Migration to v.4.0 is planned to november)

Is there a reason why RSS Import would duplicate some entries from this feed ?
http://www.toulouse.fr/web/guest/.../lire/-/journal/rss/10128/ACTUALITES

All duplicated entries have guid formed this way :

<item>
      <title>Mobilisation pour un référendum sur le service public postal</title>
      <link>http://www.toulouse.fr/web/guest/actualite/lire/-/journal_content/56_INSTANCE_3iH6/10128/1436279</link>
      <description />
      <pubDate>Fri, 02 Oct 2009 13:05:00 GMT</pubDate>
      <guid>http://www.toulouse.fr/web/guest/actualite/lire/-/journal_content/56_INSTANCE_3iH6/10128/1436279</guid>
      <dc:creator>Léonard Lemince</dc:creator>
      <dc:date>2009-10-02T13:05:00Z</dc:date>
    </item>

Whereas those which are not duplicated are formed this way :

    <item>
      <title>Le site de la semaine!</title>
      <link>http://www.toulouse.fr/web/guest/economie/innovation-technologies-de-l-information</link>
      <description />
      <pubDate>Thu, 01 Oct 2009 13:51:00 GMT</pubDate>
      <guid>http://www.toulouse.fr/web/guest/economie/innovation-technologies-de-l-information</guid>
      <dc:creator>Djet 27</dc:creator>
      <dc:date>2009-10-01T13:51:00Z</dc:date>
    </item>

Any hint welcome... I did not find anything regarding this in issues.ez.no.

Thanks !

Related forum topics

4 replies

Monday 05 October 2009 11:26:01 am

For each duplicate entry, eZ seems to add a different "jsessionid" to the link ! :

First entry :
http://www.toulouse.fr/web/guest/...nid=1E0169E94E9694BD6D0AA2E15A2F46B0

Duplicate :
http://www.toulouse.fr/web/guest/...nid=300C982D2BD28725BC61A1396C801A9A

This jsessionid does not appear anywhere in the original feed !

Monday 05 October 2009 2:33:13 pm

Well, after further investigation, it looks like a bug from liferay (generator of the rss feed) which puts these jsessionid values when called from a cookieless client.

Monday 04 June 2012 1:18:38 pm

Hi Kevin

Did you find a solution to this problem?

One of our customers has an RSS import from a feed that has recently developed a very similar 'bug': the URL is constantly changing. So I'd be interested to hear the best way to resolve this problem.

Andy

Monday 04 June 2012 4:52:45 pm

Hello ,
Here's a very usefull extension from our friend Jérôme Vieilledent that handels such problems :
http://www.lolart.net/index.php/en/blog/ez-publish/introducing-sqliimport
i've encoutred the same issue previously and fixed it by hashing the guid field in my import class that way :

 $contentOptions = new SQLIContentOptions( array(

 'class_identifier' => '[myclassidentifier]',

'remote_id' => hash('sha1',$row->guid)

) );

you can also use the md5 hash methode for that.

expandshrink

You must be logged in to post messages in this topic!

RSS import generates duplicates

Forums menu